-- Logs begin at Wed 2022-08-24 04:01:30 UTC, end at Wed 2022-08-24 05:09:02 UTC. -- Aug 24 04:39:41.350947 dv-cinder-854264-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 04:39:41.361619 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:39:41 2022] *** Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: nodename: dv-cinder-854264-1-iscsi Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: machine: x86_64 Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: clock source: unix Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: pcre jit disabled Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: detected number of CPU cores: 4 Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: current working directory: / Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: your processes number limit is 47680 Aug 24 04:39:41.365546 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: your memory page size is 4096 bytes Aug 24 04:39:41.366891 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: detected max file descriptor number: 2048 Aug 24 04:39:41.366891 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: lock engine: pthread robust mutexes Aug 24 04:39:41.366891 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: thunder lock: enabled Aug 24 04:39:41.366891 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 04:39:41.366891 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:39:41.413539 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: Python main interpreter initialized at 0x556ef573e9c0 Aug 24 04:39:41.413539 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: python threads support enabled Aug 24 04:39:41.413539 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: your server socket listen backlog is limited to 100 connections Aug 24 04:39:41.413539 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:39:41.414191 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:39:41.414304 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: *** Operational MODE: preforking *** Aug 24 04:39:41.414659 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:39:41.414659 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: spawned uWSGI master process (pid: 112370) Aug 24 04:39:41.414858 dv-cinder-854264-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 04:39:41.416240 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: spawned uWSGI worker 1 (pid: 112382, cores: 1) Aug 24 04:39:41.416240 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: spawned uWSGI worker 2 (pid: 112383, cores: 1) Aug 24 04:39:41.416240 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:39:42.225261 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:39:42.334575 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:39:43.481468 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:39:43.481468 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: from cryptography.utils import int_from_bytes Aug 24 04:39:43.482467 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:39:43.482467 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: from cryptography.utils import int_from_bytes Aug 24 04:39:43.921945 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:39:43.921945 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: from cryptography.utils import int_from_bytes Aug 24 04:39:43.922859 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:39:43.922859 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: from cryptography.utils import int_from_bytes Aug 24 04:39:47.010520 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:39:47.011381 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:39:47.011381 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:39:47.011657 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:39:47.011899 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:39:47.012293 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.012621 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.012942 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.013268 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.013604 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.013915 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.014265 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.014588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.014915 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.015180 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.015497 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.015823 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854264-1-iscsi {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.016144 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.016455 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.016767 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.017084 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.017385 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.017715 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.018041 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.018553 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.019127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.019328 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.019593 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.020455 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.020935 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.021189 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.021402 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.021690 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.022070 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.022392 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.022824 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854264-1-iscsi {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.023148 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.023467 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.023785 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.024207 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.024544 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.024840 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.025163 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.025486 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.025798 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.026157 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.026477 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.026797 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.027120 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.027424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.027735 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.028049 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.028369 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.028679 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.028986 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.029238 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.029547 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.030161 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.030487 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.030922 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.031182 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.031436 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.031924 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.032359 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.032680 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.033091 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.033498 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.033903 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.034372 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.034677 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.035025 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.035300 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.036302 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.036629 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.037313 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.037561 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.037950 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.040888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.040888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.040888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.040888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.040888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.040888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.040888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.040888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.041922 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.041922 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.041922 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.041922 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.042457 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.042587 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.042794 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.043099 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.043413 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.043738 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.044049 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.044359 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.044668 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.044970 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.045277 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.045585 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.045895 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.046229 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.046539 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.046847 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.047156 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.047463 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.047768 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.048092 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.048411 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.048721 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.049029 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.049336 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.049644 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.049962 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.050295 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.050604 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.050928 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.051268 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.051573 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.051891 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.052201 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.052628 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.052960 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.053267 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.053654 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.053904 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.054242 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.054551 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.054860 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.055166 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.055474 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.055780 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.056085 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.056391 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.056691 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.057011 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.057335 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.057650 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.057958 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.058290 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.058613 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.058956 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.059290 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.059634 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.059948 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.060283 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.060614 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.060948 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.061254 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.061574 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.061901 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.062240 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.062553 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.062866 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.063184 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.063509 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.063844 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.064168 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.064488 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.065028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.065352 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.065677 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.066049 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.066408 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.066724 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.067796 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.068234 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.068559 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.068892 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.069226 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.069546 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.069864 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.070284 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.070616 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.070987 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.071283 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.071610 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.071930 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.072249 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.072566 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.072882 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.073198 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.073557 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.073905 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.074229 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.074551 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.074875 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.075194 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.075511 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.075830 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.076141 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.076449 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.076756 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.077071 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.077378 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.077703 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.078067 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.078381 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.078725 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.079035 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.079349 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.079661 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.079975 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.080284 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.080601 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.080916 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.081224 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.081559 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.081873 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.082211 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.082672 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.083497 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.083812 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.084136 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.084460 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.084975 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.085301 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.085620 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.085956 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.086349 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.086669 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.087016 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.087354 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.087667 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.087995 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.088326 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.088646 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.088952 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.089268 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.089579 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.089887 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.090218 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.090534 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.091158 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.091158 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.091444 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.091749 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.092064 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.092399 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.092716 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.093024 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.093340 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.093645 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.093996 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.094331 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.094680 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.095018 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.095343 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.095672 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.095993 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.096308 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.096624 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.096946 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.097260 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.097579 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.097912 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.098945 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.099288 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.099609 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.099948 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.100407 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.100577 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.100892 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.101210 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.101560 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.101899 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.102291 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.102622 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.102937 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.103287 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.103580 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.103895 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.104254 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.107389 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.107389 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.107389 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.107389 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.107389 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.107389 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.107389 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.107389 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.110507 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.110507 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.110507 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.110507 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.110507 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.110507 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.110507 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.110507 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.111247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.111247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.111247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.111247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.111247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.111247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.111247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.111845 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.111845 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.112119 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.112434 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.112744 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.113053 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.113372 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.113749 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.114594 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.114931 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.115511 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.115511 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.115511 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.116351 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.116529 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.116840 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.117147 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.117521 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.117892 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.118312 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.118690 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.118989 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.119313 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.119626 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.120028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.120340 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.120655 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.121061 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.121295 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.121613 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.121931 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.122269 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.122584 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.122901 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.123228 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.123538 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.123852 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.124169 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.124472 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.124789 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.125172 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.125719 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.126088 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.126413 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.126735 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.127059 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.127381 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.127865 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.128010 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.128366 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.128675 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.129105 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.129491 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.129887 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.130231 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.130541 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.130850 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.131159 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.131473 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.131782 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.132088 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.132391 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.132695 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.133010 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.133320 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.133635 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.133945 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.134370 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.134730 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.135038 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.135344 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.135695 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.136041 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.136350 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.136691 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.137018 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.137360 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.137667 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.137975 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.138324 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.138632 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.138940 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.139245 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.139577 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.139887 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.140273 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.140595 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.140911 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.141226 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.141549 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.141835 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.142167 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.142478 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.142792 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.143103 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.143412 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.144024 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.144337 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.144636 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.144973 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.145285 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.145603 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.145909 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.146238 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.146542 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.147030 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.147350 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.147656 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.147983 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.148303 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.148611 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.148915 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.149230 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.149532 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.149835 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.150176 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.150499 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.150816 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.151120 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.151434 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.151735 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.152044 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.152351 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.152658 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.152964 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.153274 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.153579 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.153887 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.154217 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.154543 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.155106 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.155408 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.155719 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.156048 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.156420 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.156662 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.157023 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.157329 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.157645 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.157965 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.158307 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.158618 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.158931 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.159241 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.159559 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.159873 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.160263 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.160502 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.161333 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.161658 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.161982 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.162510 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.162834 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.163161 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.163494 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.163800 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.164113 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.164426 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.164739 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.165049 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.165362 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.165792 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.166134 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.166450 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.166772 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.167062 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.167379 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.167691 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.168004 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.168311 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.168639 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.168952 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.169260 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.169572 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.169879 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.170217 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.170523 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.170967 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.171281 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.171596 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.171902 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.172216 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.172531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.172851 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.173166 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.173478 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.173900 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.174245 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.174552 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.174867 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.175181 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.175485 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.175801 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.176127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.176989 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.177540 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.177890 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.178245 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.178555 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.178881 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.179313 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.179631 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.179943 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.180362 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.180680 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.180993 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.181323 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.181669 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.183374 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.183374 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.183374 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.183374 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.183374 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.184001 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.184001 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.184275 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.184398 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.184751 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.185051 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.185370 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.185732 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.186193 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.186521 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.186839 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.187170 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.187495 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.187803 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.188111 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.188426 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.188733 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.189042 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.189367 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.189676 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.189992 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.190330 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.190646 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.190956 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.191262 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.191586 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.191968 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.192353 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.192612 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.192942 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.193260 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.193573 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.193898 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.194237 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.194544 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.194852 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.195160 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.195505 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.195813 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.196137 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.196465 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.196796 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.197106 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.197443 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.197771 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.198116 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.198435 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.198759 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.199063 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.199367 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.199678 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.199983 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.200288 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.200593 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.200905 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.201207 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.201511 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.201861 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.202163 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.202470 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.202794 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.203104 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.203405 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.203714 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.204017 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.204360 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.204664 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.204997 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.205307 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.205630 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.205948 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.206295 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.206613 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.206933 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.207252 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.207605 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.207921 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.208232 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.208710 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.209036 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.209353 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.209937 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.210296 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.210608 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.210925 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.211242 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.211560 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.211875 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.212189 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.212531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.212820 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.213133 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.213465 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.213795 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.214136 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.214478 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.214801 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.215120 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.215432 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.215754 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.216112 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.216430 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.216738 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.217053 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.217371 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.217697 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.218023 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.218343 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.218654 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.218968 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.219278 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.219590 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.219902 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.220215 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.220541 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.220921 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.221190 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.221509 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.221818 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.222156 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.222710 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.223825 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.224268 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.224651 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.224979 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.225300 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.225621 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.225950 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.226283 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.226597 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.226912 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.227225 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.227535 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.227860 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.228174 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.228480 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.228802 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.229115 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.229674 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.230092 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.230372 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.230702 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.231053 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.231345 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.231654 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.231981 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.232289 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.232599 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.232916 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.233229 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.233535 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.233843 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.234219 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.234537 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.234847 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.235161 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.235466 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.235796 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.236103 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.236409 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.236721 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.237035 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.237527 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.237679 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.237939 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.238267 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.238581 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.239631 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.240032 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.240346 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.240664 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.240975 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.241290 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.241598 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.242054 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.242369 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.242724 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.243049 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.243364 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.243691 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.244007 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.244330 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.244683 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.245003 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.245594 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.245970 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.246325 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.246676 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.247015 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.247326 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.247648 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.247957 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.248290 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.248606 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.248923 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.249282 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.249603 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.249939 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.250566 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.250719 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.251044 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.251358 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.251674 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.251988 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.252301 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.252614 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.252935 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.253253 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.253608 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.253983 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.254380 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.254731 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.255054 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.255507 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.255885 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.256340 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.256749 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.257209 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.257478 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.257795 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.258191 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.258717 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.259040 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.259368 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.259698 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.260024 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.260439 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.260738 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.260993 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.261398 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.261635 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.261966 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.262419 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.262668 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.263071 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.263321 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.263636 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.263944 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.264267 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.264591 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.264904 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.265210 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.265517 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.265851 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.266232 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.266547 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.266967 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.267280 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.267595 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.267903 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.268208 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.268515 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.268822 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.269130 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.269437 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.269749 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.270134 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.270447 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.270757 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.271067 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.271375 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.271716 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.272052 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.272372 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.272694 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.273016 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.273339 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.273655 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.273980 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.274342 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.274791 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.274954 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.275297 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.275614 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.275932 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.276247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.276562 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.276874 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.277187 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.277523 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.277853 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.278181 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.278513 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.278838 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.279165 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.279482 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.280049 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.280381 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.280698 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.281012 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.281326 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.281641 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.281953 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.282300 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.282616 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.282927 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.283251 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.283572 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.283900 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.284231 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.284542 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.284873 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.285200 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.286114 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.286407 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.286756 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.287086 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.287401 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.287718 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.288028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.288268 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:39:47.445259 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO dbcounter [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Registered counter for database nova_api Aug 24 04:39:47.468757 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_db.sqlalchemy.engines [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:47.480317 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writer thread running {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:47.564689 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.context [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1da3d3a-d71f-44a7-9bcc-c0c528eed093(cell1) {{(pid=112382) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:39:47.570198 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:47.570695 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:47.572514 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:47.573374 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:47.573800 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:47.576062 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:47.578244 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO dbcounter [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Registered counter for database nova_cell0 Aug 24 04:39:47.584493 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO dbcounter [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Registered counter for database nova_cell1 Aug 24 04:39:47.593552 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_db.sqlalchemy.engines [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:47.596711 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_db.sqlalchemy.engines [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:47.605332 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writer thread running {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:47.697715 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:39:47.698624 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:39:47.698624 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:39:47.699000 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:39:47.699294 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:39:47.699695 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.700029 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.700360 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.700688 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.701026 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.701345 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.701677 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.702031 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.702359 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.702626 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.702947 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.703309 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854264-1-iscsi {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.703643 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.704022 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.704373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.704734 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.705072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.705430 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.705800 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.706434 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.706729 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.707097 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.707512 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.707939 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.708235 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.708551 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.708879 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.709193 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.709526 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.709844 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.710307 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854264-1-iscsi {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.710640 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.710957 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.711279 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.711708 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.712026 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.712341 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.712667 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.713008 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.713323 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.713661 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.713981 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.714328 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.714657 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.714960 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.715272 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.715587 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.715913 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.716222 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.716529 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.716784 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.717102 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.717427 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.717752 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.718114 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.718371 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.718624 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.718952 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.719276 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.719591 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.719904 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.720217 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.720529 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.720847 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.721135 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.721446 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.721757 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.722114 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.722439 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.722764 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.723090 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.723416 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.723867 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.724507 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.724507 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.724733 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.725075 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.725365 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.725687 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.726169 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.726365 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.726729 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.727358 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.727816 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.728329 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.728714 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.728973 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.729286 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.729602 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.729950 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.730472 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.730789 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.731105 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.731496 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.731813 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.732127 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.732598 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.732950 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.733297 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.733640 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.734058 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.734352 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.734747 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.735130 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.735455 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.735774 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.736166 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.736482 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.736798 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.737127 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.737447 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.737789 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.738153 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.738502 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.739491 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.739998 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.740456 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.740976 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.741450 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.741938 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.742438 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.742867 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.743319 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.743785 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.744251 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.744706 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.745115 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.745618 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.746117 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.746508 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.746971 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.747521 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.748047 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.748427 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.748807 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.749157 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.749544 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:47.749925 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.750308 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.750665 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.750987 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.751380 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.751673 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.751998 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.752328 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.752752 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.753185 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.753602 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.754051 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.755039 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.755466 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.755917 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.756484 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.756908 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.757336 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.757835 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.758355 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.758816 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.759251 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.759678 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.760097 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.760554 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.761000 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.761419 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.761849 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.762356 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.762840 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.763289 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.763761 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.764242 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.764706 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.765150 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.765609 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.766151 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.766646 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.767164 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.767608 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.768098 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.768560 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.769032 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.769454 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.769878 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.770775 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.771197 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.771638 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.771996 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.772326 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.772646 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.772971 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.773301 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.773615 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.773954 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.774332 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.774650 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.774996 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.775309 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.775632 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.775947 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.776267 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.776575 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.776897 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.777242 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.777563 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.777899 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.778251 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.778590 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.778929 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.779240 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.779556 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.780139 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.780457 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.780778 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.781095 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.781413 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.781743 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.782092 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.782452 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.782869 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.783168 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.783489 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.783846 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.784182 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.784556 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.784869 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.785184 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.785495 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.785829 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.786796 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.786796 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.786796 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.787114 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.787369 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.787680 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.787992 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.788328 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.788644 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.788957 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.789269 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.789577 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.789930 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.790266 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.790619 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.790962 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.791291 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.791617 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.791938 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.792260 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.792581 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.792899 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.793218 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.793538 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.793963 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.794237 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.794570 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.794818 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.795142 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.795460 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.795872 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.796110 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.796391 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.796740 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.797080 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.797400 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.797731 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.798072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.798396 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.798710 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.799030 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.799346 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.799708 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.800034 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.800349 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.800674 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.800988 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.801856 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.802359 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.802837 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.803194 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.803629 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.803932 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.804442 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.804766 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.805093 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.805622 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.806124 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.806450 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.806774 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.807236 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.807591 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.807910 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.808238 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.808565 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.808977 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.809292 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.809750 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.810321 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.810882 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.811191 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.811597 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.811918 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.812272 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.812660 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.813065 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.813335 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.813679 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.814090 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.814474 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.814758 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.815599 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.815599 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.815784 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.816094 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.816421 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.816800 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.817891 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.818284 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.818619 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.818946 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.819269 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.819643 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.819993 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.820346 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.820669 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.821021 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.821370 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.821690 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.822055 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.822373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.822694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.823011 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.823323 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.823645 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.823968 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.824729 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.824979 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.825204 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.825523 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writer thread running {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:47.825769 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.826022 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.826283 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.826659 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.826886 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.827206 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.827522 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.827841 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.828155 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.828466 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.828782 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.829097 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.829414 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.829725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.830079 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.830378 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.830690 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.830999 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.831309 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.831633 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.831942 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.832263 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.832607 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.832941 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.833256 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.833564 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.833876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.834229 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.834580 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.834868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.835285 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.835682 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.836028 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.836281 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.836609 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.836948 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.837283 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.837592 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.837903 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.838235 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.838549 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.838866 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.839326 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.839596 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.839868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.840214 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.840550 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.840889 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.841200 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.841522 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.841834 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.842173 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.842479 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.842742 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO dbcounter [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Registered counter for database nova_cell0 Aug 24 04:39:47.842989 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.843227 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.843495 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.843733 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.843986 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.844277 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.844573 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.844880 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.845362 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.845624 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.845878 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.846150 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.846466 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.846856 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.847427 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.847618 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.847788 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.848602 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.849068 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.849397 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.849748 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.850086 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.850401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.850720 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.851030 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.851342 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.851652 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.851967 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.852279 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.852594 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.852904 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.853215 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.853525 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.853759 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_db.sqlalchemy.engines [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:47.853968 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.854219 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.854573 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.854917 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.855256 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.855635 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.855945 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.856306 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.856616 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.856944 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.857269 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.857592 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.857933 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.858265 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.858576 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.858897 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.859216 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.859538 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.859840 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.860324 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.860492 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writer thread running {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:47.860651 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.860965 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.861285 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.861617 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.861942 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.862314 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.862625 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.862944 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.863261 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.863575 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.864447 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.864873 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.865196 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.865515 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.865833 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.866178 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.866499 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.866812 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.867128 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.867443 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.867755 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.868091 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.868411 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.868720 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.869036 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.869344 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.869670 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.869976 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.870448 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.870765 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.871084 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.871428 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.871748 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.872066 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.872387 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.872711 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.873019 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.873459 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.873780 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.874192 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.874453 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.874739 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.875043 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.875361 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.875696 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.876063 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.876373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.876687 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.877084 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.877395 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.877719 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.878225 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.878545 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.878858 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.879927 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.880247 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.880574 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.880901 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.881229 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.881559 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.881870 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.882225 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.882540 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.882875 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.883205 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.883526 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.883846 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.884135 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.884469 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.884794 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.885112 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.885437 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.885872 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.886228 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.886549 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.886875 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.887212 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.887521 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.887831 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.888145 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.888499 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.888793 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.889176 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.889559 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.889890 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.890257 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.890610 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.890950 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.891278 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.891685 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.891968 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.892320 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.893621 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.893621 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.893621 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.893621 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897335 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897335 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897335 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897335 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897335 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897335 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897335 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897335 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897973 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897973 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.897973 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.898206 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.898558 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.899012 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.899570 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.900027 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.900513 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.900904 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.901437 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.901899 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.902440 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.902849 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.903273 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.903677 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.904031 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.904386 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.905009 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.905363 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.905735 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.906149 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.906575 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.906950 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.907305 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.907747 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.908101 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.908494 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.908909 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.909284 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.909665 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.910067 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.910600 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.911641 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.911641 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.911908 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.912140 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.912505 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.912896 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.913244 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.913609 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.914267 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.914661 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.915020 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.915382 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.915754 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.916136 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.916509 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.916980 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.917313 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.917679 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.918078 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.918572 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.918885 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.919336 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.919803 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.920293 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.920821 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.921295 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.921793 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.922319 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.922744 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.923157 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.923580 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.924001 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.924445 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.924870 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.925308 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.925737 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.926291 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.926697 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.927193 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.927648 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.928160 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.928592 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.929105 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.929545 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.929974 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.930420 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.930878 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.931546 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.931969 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.932419 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.932874 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.933307 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.933729 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.934214 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.934664 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.935081 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.935493 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.935910 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.936343 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.936765 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.937288 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.937638 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.938031 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.938426 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.938845 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.939559 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.939967 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.940340 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.940717 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.941140 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.941506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.942515 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.942959 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.943514 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.943922 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.944336 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.944759 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.945256 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.945667 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.946133 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.946592 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.946999 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.947569 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.947937 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.948422 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.948864 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.951868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.951868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.951868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.951868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.951868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.951868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.951868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.951868 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.952952 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.952952 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.953258 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.953767 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.954251 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.954668 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.955131 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.955648 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.956140 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.956589 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.956965 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.957359 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.958680 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.959314 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.959786 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.960214 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.960589 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.961262 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.961687 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.962091 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.962495 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.962877 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.963235 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.963633 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.963980 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.964364 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.964727 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.965083 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.965445 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.965833 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.966230 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.966586 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.966962 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.967329 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.967704 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.968067 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.968506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.968864 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.969251 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.969635 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.970112 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.970516 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.970908 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.971310 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.971694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.972078 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.972577 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.973078 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.974180 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.974668 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.975187 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.975708 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.976214 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.976700 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.977319 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.977855 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.978343 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.978846 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.979272 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.979708 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.980204 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.980625 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.981050 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.981491 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.981953 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.982429 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.982863 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.983298 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.983709 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.984130 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.984544 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.984958 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.985379 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.985789 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.986258 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.986677 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.987091 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.987500 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.987910 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.988334 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.988718 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.989137 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.990054 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.990054 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.990054 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.990703 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.990703 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.991004 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.991265 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.991579 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.991901 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.992205 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.992520 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.992831 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.993177 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.993522 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.993852 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.994212 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.994541 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.994877 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.995198 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.995521 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.995852 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.996180 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.996498 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.996838 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.997165 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.997483 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.997800 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.998149 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.998469 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.998789 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.999124 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.999456 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:47.999770 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.000103 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.000432 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.000764 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.001086 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.001478 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.001831 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.002210 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.002565 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.002885 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.003253 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.003579 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.003850 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.004175 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.005082 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.005441 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.005766 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.006126 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.006458 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.006772 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.007166 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.007500 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.007867 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.008411 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.009032 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.009628 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.009982 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.010333 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.010649 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:48.010898 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:39:48.170071 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO dbcounter [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Registered counter for database nova_api Aug 24 04:39:48.193892 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_db.sqlalchemy.engines [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:48.201598 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writer thread running {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:48.250409 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: WARNING keystonemiddleware.auth_token [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:39:48.259219 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: WARNING keystonemiddleware.auth_token [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:39:48.265315 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.context [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1da3d3a-d71f-44a7-9bcc-c0c528eed093(cell1) {{(pid=112383) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:39:48.269433 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_concurrency.lockutils [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:48.269963 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_concurrency.lockutils [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:48.272430 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_concurrency.lockutils [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:48.273241 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_concurrency.lockutils [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:48.273695 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_concurrency.lockutils [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:48.275765 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_concurrency.lockutils [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:48.277850 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO dbcounter [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Registered counter for database nova_cell0 Aug 24 04:39:48.284053 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO dbcounter [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Registered counter for database nova_cell1 Aug 24 04:39:48.296473 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_db.sqlalchemy.engines [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:48.299429 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_db.sqlalchemy.engines [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:48.309664 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writer thread running {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:48.314633 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writer thread running {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:48.487796 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO dbcounter [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Registered counter for database nova_cell0 Aug 24 04:39:48.502108 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG oslo_db.sqlalchemy.engines [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:48.508896 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writer thread running {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:48.615992 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: WARNING keystonemiddleware.auth_token [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:39:48.622096 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: WARNING keystonemiddleware.auth_token [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:39:48.627401 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556ef573e9c0 pid: 112382 (default app) Aug 24 04:39:48.629900 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:48.631165 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002194 Aug 24 04:39:48.631590 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Aug 24 04:39:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:48.835851 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: WARNING keystonemiddleware.auth_token [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:39:48.843828 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: WARNING keystonemiddleware.auth_token [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:39:49.255705 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: WARNING keystonemiddleware.auth_token [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:39:49.263568 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: WARNING keystonemiddleware.auth_token [None req-3599bc9d-7550-4ab2-ae72-6f45ad385627 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:39:49.270655 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x556ef573e9c0 pid: 112383 (default app) Aug 24 04:41:24.429388 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:24.431751 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003002 Aug 24 04:41:24.432360 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:41:24.445486 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writing DB stats nova_api:SELECT=3 {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:24.446871 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writing DB stats nova_cell0:SELECT=3 {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:24.447634 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writing DB stats nova_cell1:SELECT=3 {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:24.448952 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writing DB stats nova_cell0:SELECT=3 {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:25.409385 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-6fe63184-95d6-4a5b-9538-a4441020be37 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:25.450513 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-6fe63184-95d6-4a5b-9538-a4441020be37 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.010331 Aug 24 04:41:25.451723 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 24 04:41:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:28.010267 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:28.010885 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-f9bd3d56-d350-49b2-bb52-981504fe15da None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Aug 24 04:41:28.011587 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:28.499495 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-5fda0112-3ef7-4fb6-9a4c-4f260f84db5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "id": "c1"}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:28.524048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:41:28.524048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: warnings.warn(msg) Aug 24 04:41:28.567556 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-5fda0112-3ef7-4fb6-9a4c-4f260f84db5a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.545458 Aug 24 04:41:28.568705 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:41:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:28.583385 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_api:SELECT=3 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.584665 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_cell1:SELECT=3 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.585673 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_cell0:SELECT=3 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.586667 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.798980 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-190d3290-4f4f-4e2e-95f0-a609b29d273a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:28.803987 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:41:28.803987 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: warnings.warn(msg) Aug 24 04:41:28.867745 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-190d3290-4f4f-4e2e-95f0-a609b29d273a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289755 Aug 24 04:41:28.868263 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 24 04:41:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:31.407187 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-5fda0112-3ef7-4fb6-9a4c-4f260f84db5a admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:31.409050 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-5fda0112-3ef7-4fb6-9a4c-4f260f84db5a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002306 Aug 24 04:41:31.409639 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:32.273636 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-daea9bcb-1760-44ab-89d0-c8d86bdf5666 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:32.296144 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:41:32.296144 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: warnings.warn(msg) Aug 24 04:41:32.323881 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-daea9bcb-1760-44ab-89d0-c8d86bdf5666 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.906560 Aug 24 04:41:32.324934 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:41:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:32.342313 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-156c7b08-933e-48f1-a007-84adcde7a5cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:32.345805 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:41:32.345805 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: warnings.warn(msg) Aug 24 04:41:32.393451 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-156c7b08-933e-48f1-a007-84adcde7a5cc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054560 Aug 24 04:41:32.402038 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 24 04:41:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:41:35.039537 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-daea9bcb-1760-44ab-89d0-c8d86bdf5666 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:35.040573 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-daea9bcb-1760-44ab-89d0-c8d86bdf5666 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Aug 24 04:41:35.040992 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:35.555106 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-51f38e4f-a4bd-49db-839a-fcc97e95b87f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:35.575483 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-51f38e4f-a4bd-49db-839a-fcc97e95b87f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.527309 Aug 24 04:41:35.576046 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:41:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:35.589052 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-ff99a687-1d62-4c3f-a968-b8075d2a6ad1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:35.625372 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-ff99a687-1d62-4c3f-a968-b8075d2a6ad1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040016 Aug 24 04:41:35.626395 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 24 04:41:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:38.150306 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-51f38e4f-a4bd-49db-839a-fcc97e95b87f admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:38.151422 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-51f38e4f-a4bd-49db-839a-fcc97e95b87f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001857 Aug 24 04:41:38.152247 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:38.731473 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-423aac7d-eca8-4312-88a2-3832c6789d98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G"}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:38.757398 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-423aac7d-eca8-4312-88a2-3832c6789d98 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.596900 Aug 24 04:41:38.759032 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:41:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:41:38.771826 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-812333a8-2f9d-4588-b1b3-4cb9adacf71c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:38.802166 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-812333a8-2f9d-4588-b1b3-4cb9adacf71c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034194 Aug 24 04:41:38.804221 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 24 04:41:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:41:41.460912 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-423aac7d-eca8-4312-88a2-3832c6789d98 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:41.461930 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-423aac7d-eca8-4312-88a2-3832c6789d98 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 24 04:41:41.462616 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:41.973444 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-b17151cf-e4c9-442b-b073-cbad01c391cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "disk": 20}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:42.000104 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-b17151cf-e4c9-442b-b073-cbad01c391cc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531011 Aug 24 04:41:42.000730 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:41:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:42.014601 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-7da868a7-97f3-4ce8-afad-be7168e32285 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:42.045251 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-7da868a7-97f3-4ce8-afad-be7168e32285 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034294 Aug 24 04:41:42.046839 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 24 04:41:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:41:44.526520 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-b17151cf-e4c9-442b-b073-cbad01c391cc admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:44.527552 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-b17151cf-e4c9-442b-b073-cbad01c391cc admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 24 04:41:44.527962 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:44.995617 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-de691cfc-9a23-4054-bff0-c4b25454d58b admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:45.023188 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-de691cfc-9a23-4054-bff0-c4b25454d58b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.487685 Aug 24 04:41:45.024018 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 24 04:41:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:41:47.671640 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-b17151cf-e4c9-442b-b073-cbad01c391cc admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:47.672995 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-b17151cf-e4c9-442b-b073-cbad01c391cc admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Aug 24 04:41:47.673586 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:48.150759 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-935180af-0398-41e2-afe7-9b18f1a17c8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "swap": 0}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:48.175966 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-935180af-0398-41e2-afe7-9b18f1a17c8a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.494571 Aug 24 04:41:48.176683 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:41:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:48.190025 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-aff5bec6-b1bc-4601-883e-d1538c0b15f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:48.217584 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-aff5bec6-b1bc-4601-883e-d1538c0b15f0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031223 Aug 24 04:41:48.218513 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 24 04:41:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:50.768921 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-935180af-0398-41e2-afe7-9b18f1a17c8a admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:50.770267 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-935180af-0398-41e2-afe7-9b18f1a17c8a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 04:41:50.770267 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:51.229749 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-b49aac41-2262-49d1-96a5-04e7908da9b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "swap": 0}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:51.249763 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-b49aac41-2262-49d1-96a5-04e7908da9b8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472814 Aug 24 04:41:51.250606 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:41:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:51.263644 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-516adaa3-c829-4e1b-a7e9-7dcf4ec01e81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:51.293373 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-516adaa3-c829-4e1b-a7e9-7dcf4ec01e81 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033567 Aug 24 04:41:51.295694 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 24 04:41:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:53.870711 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-b49aac41-2262-49d1-96a5-04e7908da9b8 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:53.871809 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-b49aac41-2262-49d1-96a5-04e7908da9b8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 24 04:41:53.872215 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:54.455311 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-dfd47216-30a5-4e8d-b47b-9972b050eafd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "ram": 4096}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:54.494824 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-dfd47216-30a5-4e8d-b47b-9972b050eafd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.615271 Aug 24 04:41:54.508203 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:41:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:41:54.517570 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-c059d9b8-5d1c-4129-91f9-8a2d478c5f88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:54.524595 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:54.555695 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-c059d9b8-5d1c-4129-91f9-8a2d478c5f88 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045260 Aug 24 04:41:54.556689 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 24 04:41:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:57.838715 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-dfd47216-30a5-4e8d-b47b-9972b050eafd admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:57.839332 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-dfd47216-30a5-4e8d-b47b-9972b050eafd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Aug 24 04:41:57.839545 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:58.423923 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-7eae06df-93cc-4b90-b214-bfce9c8171ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "swap": 0}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:58.450774 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-7eae06df-93cc-4b90-b214-bfce9c8171ba admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.604152 Aug 24 04:41:58.454261 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:41:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:41:58.468174 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-aa329a77-b9cb-4463-bed7-713e3c594d44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:58.504714 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-aa329a77-b9cb-4463-bed7-713e3c594d44 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033937 Aug 24 04:41:58.506748 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 24 04:41:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:01.298956 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-7eae06df-93cc-4b90-b214-bfce9c8171ba admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:01.305939 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-7eae06df-93cc-4b90-b214-bfce9c8171ba admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Aug 24 04:42:01.307318 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:01.873728 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-4aebdaa5-fcbf-468b-842b-cb8988fab361 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:01.888351 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:01.913003 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-4aebdaa5-fcbf-468b-842b-cb8988fab361 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.603747 Aug 24 04:42:01.913724 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 24 04:42:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:42:01.929469 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-f7f96e1b-cb9a-4d5d-aa6c-9d917777e7c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:01.964499 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-f7f96e1b-cb9a-4d5d-aa6c-9d917777e7c7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038845 Aug 24 04:42:01.965573 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 24 04:42:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:42:24.720006 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-4aebdaa5-fcbf-468b-842b-cb8988fab361 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:24.721010 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-4aebdaa5-fcbf-468b-842b-cb8988fab361 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 24 04:42:24.721599 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:42:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:42:24.734380 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:25.387291 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-439f09b1-6eba-4281-b3f2-bb4457883898 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:25.421859 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-439f09b1-6eba-4281-b3f2-bb4457883898 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.691747 Aug 24 04:42:25.422875 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 24 04:42:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:42:26.673410 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-4aebdaa5-fcbf-468b-842b-cb8988fab361 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:26.674476 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-4aebdaa5-fcbf-468b-842b-cb8988fab361 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 24 04:42:26.674933 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:27.460440 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-2cf7d0f4-24b2-4328-b733-3039479db499 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:27.471375 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.wsgi [None req-2cf7d0f4-24b2-4328-b733-3039479db499 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-2cf7d0f4-24b2-4328-b733-3039479db499 admin admin] Request method failure captured: Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Accept: application/json Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Accept-Encoding: gzip, deflate Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Connection: keep-alive Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Content-Length: 0 Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Host: 10.222.0.60 Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Openstack-Api-Version: compute 2.90 Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Openstack-System-Scope: None Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: User-Agent: python-novaclient Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Auth-Token: gAAAAABjBawyKlqLwbj9WTbicxuT3aGbBpIRN2-HywdDLJM4n-q5nV7gAqJgte9RTIilDtfQrHh6AS0TihsrFKy6i4YcZh-EEDQGHiO_PUMmTj7tNwqzyRKHkhMFrYkgK4dTFO0rW7A0g-8vNLC_zav2TJTUH4c2cKcvDahFRKUVd5iWHemX2Uc Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Domain-Id: None Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Domain-Name: None Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Identity-Status: Confirmed Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Is-Admin-Project: True Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Domain-Id: default Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Domain-Name: Default Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Name: admin Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Role: reader,admin,member Aug 24 04:42:27.477876 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Roles: reader,admin,member Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf2e773339be4f8c901a00279461fb0b"}]}] Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Tenant: admin Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Tenant-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Tenant-Name: admin Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User: admin Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Domain-Id: default Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Domain-Name: Default Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Id: 1ba7af08097545aca04c4a8a9cca454f Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Name: admin Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: method: > Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: exception: Flavor 42 could not be found. Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: action_args: {'id': '42'} Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:42:27.480138 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:27.481401 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.483373 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-2cf7d0f4-24b2-4328-b733-3039479db499 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:42:27.485352 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-2cf7d0f4-24b2-4328-b733-3039479db499 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.631873 Aug 24 04:42:27.485352 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 24 04:42:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 634 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:27.496798 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-81ba6fc8-3e49-488b-9f0d-f13024a7ecd2 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:27.535673 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-81ba6fc8-3e49-488b-9f0d-f13024a7ecd2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.044590 Aug 24 04:42:27.537966 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 24 04:42:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:42:27.552925 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-6cbe126c-e36a-445c-b1be-4b8952e68f7f admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:27.590221 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-6cbe126c-e36a-445c-b1be-4b8952e68f7f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.043499 Aug 24 04:42:27.591074 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 24 04:42:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:42:27.605975 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-bb617174-bbf2-482a-b5b6-72e04b1bd2e0 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:27.616490 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.wsgi [None req-bb617174-bbf2-482a-b5b6-72e04b1bd2e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-bb617174-bbf2-482a-b5b6-72e04b1bd2e0 admin admin] Request method failure captured: Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Accept: application/json Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Accept-Encoding: gzip, deflate Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Connection: keep-alive Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Content-Length: 0 Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Host: 10.222.0.60 Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Openstack-Api-Version: compute 2.90 Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Openstack-System-Scope: None Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: User-Agent: python-novaclient Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Auth-Token: gAAAAABjBawyKlqLwbj9WTbicxuT3aGbBpIRN2-HywdDLJM4n-q5nV7gAqJgte9RTIilDtfQrHh6AS0TihsrFKy6i4YcZh-EEDQGHiO_PUMmTj7tNwqzyRKHkhMFrYkgK4dTFO0rW7A0g-8vNLC_zav2TJTUH4c2cKcvDahFRKUVd5iWHemX2Uc Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Domain-Id: None Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Domain-Name: None Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Identity-Status: Confirmed Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Is-Admin-Project: True Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Domain-Id: default Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Domain-Name: Default Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Name: admin Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Role: reader,admin,member Aug 24 04:42:27.622806 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Roles: reader,admin,member Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf2e773339be4f8c901a00279461fb0b"}]}] Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Tenant: admin Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Tenant-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Tenant-Name: admin Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User: admin Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Domain-Id: default Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Domain-Name: Default Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Id: 1ba7af08097545aca04c4a8a9cca454f Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Name: admin Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: method: > Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: exception: Flavor 42 could not be found. Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: action_args: {'id': '42'} Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:42:27.625138 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:27.627028 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:27.629531 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-bb617174-bbf2-482a-b5b6-72e04b1bd2e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:42:27.632462 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-bb617174-bbf2-482a-b5b6-72e04b1bd2e0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.026282 Aug 24 04:42:27.632462 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 24 04:42:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 04:42:28.945862 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-6cbe126c-e36a-445c-b1be-4b8952e68f7f admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:28.947784 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-6cbe126c-e36a-445c-b1be-4b8952e68f7f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002630 Aug 24 04:42:28.948516 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:42:28 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:30.010159 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-163c3542-479d-42b5-8cf5-fb37733f5410 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:30.023952 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.wsgi [None req-163c3542-479d-42b5-8cf5-fb37733f5410 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-163c3542-479d-42b5-8cf5-fb37733f5410 admin admin] Request method failure captured: Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Accept: application/json Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Accept-Encoding: gzip, deflate Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Connection: keep-alive Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Content-Length: 0 Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Host: 10.222.0.60 Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Openstack-Api-Version: compute 2.90 Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Openstack-System-Scope: None Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: User-Agent: python-novaclient Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Auth-Token: gAAAAABjBaw0C0KJ2mE-wkmYkMWZGNQ3WHENHB7wck0wsT_Oz3Wxh3nxIfs7pqFwMlVshva92n2nP2Th9lazE5L3BG72LHk-Bv7cV87Yjnwlx5Pn3Z2niigRI6aweQYjSl4k20-WTMQQj3otL16zKRbF8mBNKKGzc8PC53LM-4rU3hmqsrS4s9I Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Domain-Id: None Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Domain-Name: None Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Identity-Status: Confirmed Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Is-Admin-Project: True Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Domain-Id: default Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Domain-Name: Default Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Name: admin Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Role: reader,admin,member Aug 24 04:42:30.027247 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Roles: reader,admin,member Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf2e773339be4f8c901a00279461fb0b"}]}] Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Tenant: admin Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Tenant-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Tenant-Name: admin Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User: admin Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Domain-Id: default Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Domain-Name: Default Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Id: 1ba7af08097545aca04c4a8a9cca454f Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Name: admin Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: method: > Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: exception: Flavor 84 could not be found. Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: action_args: {'id': '84'} Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:42:30.030424 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:30.031972 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.033743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-163c3542-479d-42b5-8cf5-fb37733f5410 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:42:30.034928 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-163c3542-479d-42b5-8cf5-fb37733f5410 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.804504 Aug 24 04:42:30.034928 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 24 04:42:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 807 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:30.045372 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-59e4a21a-fb64-4b5d-9834-5e869b652d2f admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:30.066912 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-59e4a21a-fb64-4b5d-9834-5e869b652d2f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026017 Aug 24 04:42:30.067552 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 24 04:42:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:42:30.084350 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-8290bfe4-eedc-447c-b969-aae56adf25b3 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:30.111239 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-8290bfe4-eedc-447c-b969-aae56adf25b3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033287 Aug 24 04:42:30.112137 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 24 04:42:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:42:30.130054 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-6f34a0d0-f2ce-4f26-a8b0-9793cbf4fc24 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:30.142828 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.wsgi [None req-6f34a0d0-f2ce-4f26-a8b0-9793cbf4fc24 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-6f34a0d0-f2ce-4f26-a8b0-9793cbf4fc24 admin admin] Request method failure captured: Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Accept: application/json Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Accept-Encoding: gzip, deflate Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Connection: keep-alive Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Content-Length: 0 Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Host: 10.222.0.60 Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Openstack-Api-Version: compute 2.90 Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Openstack-System-Scope: None Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: User-Agent: python-novaclient Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Auth-Token: gAAAAABjBaw0C0KJ2mE-wkmYkMWZGNQ3WHENHB7wck0wsT_Oz3Wxh3nxIfs7pqFwMlVshva92n2nP2Th9lazE5L3BG72LHk-Bv7cV87Yjnwlx5Pn3Z2niigRI6aweQYjSl4k20-WTMQQj3otL16zKRbF8mBNKKGzc8PC53LM-4rU3hmqsrS4s9I Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Domain-Id: None Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Domain-Name: None Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Identity-Status: Confirmed Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Is-Admin-Project: True Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Domain-Id: default Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Domain-Name: Default Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Name: admin Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Role: reader,admin,member Aug 24 04:42:30.146073 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Roles: reader,admin,member Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf2e773339be4f8c901a00279461fb0b"}]}] Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Tenant: admin Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Tenant-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Tenant-Name: admin Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User: admin Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Domain-Id: default Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Domain-Name: Default Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Id: 1ba7af08097545aca04c4a8a9cca454f Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Name: admin Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: method: > Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: exception: Flavor 84 could not be found. Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: action_args: {'id': '84'} Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:42:30.148603 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:30.149694 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:30.151506 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-6f34a0d0-f2ce-4f26-a8b0-9793cbf4fc24 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:42:30.153459 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-6f34a0d0-f2ce-4f26-a8b0-9793cbf4fc24 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.026371 Aug 24 04:42:30.153459 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 24 04:42:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:31.542816 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-8290bfe4-eedc-447c-b969-aae56adf25b3 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:31.544090 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-8290bfe4-eedc-447c-b969-aae56adf25b3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Aug 24 04:42:31.544616 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:42:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:32.561532 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-d27b58e5-d93d-4c9c-a7ec-f33ea0f50498 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:32.573804 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.wsgi [None req-d27b58e5-d93d-4c9c-a7ec-f33ea0f50498 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-d27b58e5-d93d-4c9c-a7ec-f33ea0f50498 admin admin] Request method failure captured: Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Accept: application/json Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Accept-Encoding: gzip, deflate Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Connection: keep-alive Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Content-Length: 0 Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Host: 10.222.0.60 Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Openstack-Api-Version: compute 2.90 Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Openstack-System-Scope: None Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: User-Agent: python-novaclient Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Auth-Token: gAAAAABjBaw3Aym13B5p_koGydcBHxyraJgDOiDb12pAQoSYFDtTNoQdSTbiLOo6EeH05ahn-x4jX2U2OMJ0ovJmh5YMZWB1Nulrp2VsO3BSCO2dcXvaPEIsjsKAkGfyuJymmHddF6La00FalE597dBPzpU-fxvEYeHagfpF7wbf1JnDLZRZ6Hc Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Domain-Id: None Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Domain-Name: None Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Identity-Status: Confirmed Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Is-Admin-Project: True Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Domain-Id: default Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Domain-Name: Default Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Project-Name: admin Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Role: reader,admin,member Aug 24 04:42:32.577246 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Roles: reader,admin,member Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf2e773339be4f8c901a00279461fb0b"}]}] Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Tenant: admin Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Tenant-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-Tenant-Name: admin Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User: admin Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Domain-Id: default Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Domain-Name: Default Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Id: 1ba7af08097545aca04c4a8a9cca454f Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: X-User-Name: admin Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: method: > Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: exception: Flavor 451 could not be found. Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: action_args: {'id': '451'} Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:42:32.580072 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:32.582725 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.585048 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-d27b58e5-d93d-4c9c-a7ec-f33ea0f50498 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:42:32.587012 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-d27b58e5-d93d-4c9c-a7ec-f33ea0f50498 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.880659 Aug 24 04:42:32.587012 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 24 04:42:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 883 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:32.597866 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-e8af70ba-b46f-4a19-bfc2-9f0cbcf43c0f admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:32.628880 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-e8af70ba-b46f-4a19-bfc2-9f0cbcf43c0f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.037523 Aug 24 04:42:32.629888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 24 04:42:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:42:32.648721 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:32.677296 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035363 Aug 24 04:42:32.678466 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 24 04:42:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:42:32.697046 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-c7ee4d19-5587-4c50-a1c0-398f49214508 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:32.707447 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.wsgi [None req-c7ee4d19-5587-4c50-a1c0-398f49214508 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-c7ee4d19-5587-4c50-a1c0-398f49214508 admin admin] Request method failure captured: Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Accept: application/json Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Accept-Encoding: gzip, deflate Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Connection: keep-alive Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Content-Length: 0 Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Host: 10.222.0.60 Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Openstack-Api-Version: compute 2.90 Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Openstack-System-Scope: None Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: User-Agent: python-novaclient Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Auth-Token: gAAAAABjBaw3Aym13B5p_koGydcBHxyraJgDOiDb12pAQoSYFDtTNoQdSTbiLOo6EeH05ahn-x4jX2U2OMJ0ovJmh5YMZWB1Nulrp2VsO3BSCO2dcXvaPEIsjsKAkGfyuJymmHddF6La00FalE597dBPzpU-fxvEYeHagfpF7wbf1JnDLZRZ6Hc Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Domain-Id: None Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Domain-Name: None Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Identity-Status: Confirmed Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Is-Admin-Project: True Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Domain-Id: default Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Domain-Name: Default Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Project-Name: admin Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Role: reader,admin,member Aug 24 04:42:32.711914 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Roles: reader,admin,member Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf2e773339be4f8c901a00279461fb0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf2e773339be4f8c901a00279461fb0b"}]}] Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Tenant: admin Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Tenant-Id: bf2e773339be4f8c901a00279461fb0b Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-Tenant-Name: admin Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User: admin Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Domain-Id: default Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Domain-Name: Default Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Id: 1ba7af08097545aca04c4a8a9cca454f Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: X-User-Name: admin Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: method: > Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: exception: Flavor 451 could not be found. Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: action_args: {'id': '451'} Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:42:32.714127 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:32.715588 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: ERROR nova.api.openstack.wsgi Aug 24 04:42:32.717363 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-c7ee4d19-5587-4c50-a1c0-398f49214508 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:42:32.718857 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-c7ee4d19-5587-4c50-a1c0-398f49214508 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.025427 Aug 24 04:42:32.718857 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 24 04:42:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:34.438505 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:34.439598 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Aug 24 04:42:34.440036 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:42:35.389963 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-b4a869fd-e977-4a92-832c-04119b588ba6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:35.418374 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-b4a869fd-e977-4a92-832c-04119b588ba6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.823949 Aug 24 04:42:35.419329 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 24 04:42:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:42:36.866818 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:36.868598 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003268 Aug 24 04:42:36.869399 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:37.822658 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-c0aae0e2-5e94-4a8c-a48e-14f723ade284 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:37.859058 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-c0aae0e2-5e94-4a8c-a48e-14f723ade284 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.827370 Aug 24 04:42:37.860129 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 24 04:42:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:42:39.608059 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:39.609574 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001823 Aug 24 04:42:39.610059 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:40.538685 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-e5ffb64c-4143-4163-8dcb-53dfe0cb175a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:40.567776 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-e5ffb64c-4143-4163-8dcb-53dfe0cb175a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.800862 Aug 24 04:42:40.569561 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 24 04:42:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:42:41.761316 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:41.763291 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002732 Aug 24 04:42:41.764046 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:42:41 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:42.713743 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-08dde577-1821-43e4-af49-dc209d832362 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:42.750303 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-08dde577-1821-43e4-af49-dc209d832362 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.697365 Aug 24 04:42:42.751374 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 24 04:42:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:42:43.980029 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:43.981784 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002456 Aug 24 04:42:43.982573 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:42:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:44.917921 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-5d61c178-ba1e-4211-8d16-b2dcd5ed6732 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:44.957862 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-5d61c178-ba1e-4211-8d16-b2dcd5ed6732 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.748576 Aug 24 04:42:44.959654 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Aug 24 04:42:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:43:45.140850 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:45.141790 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-067a71b6-7933-4d39-9a85-13b6a9604a56 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 24 04:43:45.142252 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 24 04:43:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:43:45.150330 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:45.624167 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-a35aa746-5479-4a73-a748-8de4f2590579 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:45.645053 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-a35aa746-5479-4a73-a748-8de4f2590579 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.496005 Aug 24 04:43:45.645520 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 24 04:43:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:43:45.667339 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG dbcounter [-] [112383] Writing DB stats nova_api:SELECT=14 {{(pid=112383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:45.671298 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-0fe49345-778a-415e-9564-6590287de726 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:45.680689 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-0fe49345-778a-415e-9564-6590287de726 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014731 Aug 24 04:43:45.681310 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Aug 24 04:43:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:45.693594 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-aed46ac9-a891-49df-8d51-879b4e9727bf admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:45.701685 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-aed46ac9-a891-49df-8d51-879b4e9727bf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011775 Aug 24 04:43:45.702202 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Aug 24 04:43:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:45.714716 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:45.722547 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012008 Aug 24 04:43:45.723686 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Aug 24 04:43:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:45.737502 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-651902d4-87d0-4f02-b5ea-a6fe8645d277 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:45.746167 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-651902d4-87d0-4f02-b5ea-a6fe8645d277 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014113 Aug 24 04:43:45.746723 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Aug 24 04:43:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:46.642641 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:46.643656 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 24 04:46:46.644053 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:46:46.790337 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_api:SELECT=6 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:46.956238 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-47930932-37bf-4057-b698-6f7a1bac4b82 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:46.958600 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:46.958600 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: warnings.warn(msg) Aug 24 04:46:46.959723 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-47930932-37bf-4057-b698-6f7a1bac4b82 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:46.960202 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-47930932-37bf-4057-b698-6f7a1bac4b82 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:46.960643 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-47930932-37bf-4057-b698-6f7a1bac4b82 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:46.961367 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-47930932-37bf-4057-b698-6f7a1bac4b82 admin admin] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:46.961818 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-47930932-37bf-4057-b698-6f7a1bac4b82 admin admin] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:46.962263 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-47930932-37bf-4057-b698-6f7a1bac4b82 admin admin] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:46.999975 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-47930932-37bf-4057-b698-6f7a1bac4b82 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.214780 Aug 24 04:46:47.000651 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 24 04:46:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:46:47.855428 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:47.856501 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Aug 24 04:46:47.856899 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:46:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:46:48.060099 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-3e3d1006-832a-4b11-a72f-5ac4654ef3f7 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:48.063061 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:48.063061 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: warnings.warn(msg) Aug 24 04:46:48.064168 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-3e3d1006-832a-4b11-a72f-5ac4654ef3f7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:48.064675 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-3e3d1006-832a-4b11-a72f-5ac4654ef3f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:48.065082 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-3e3d1006-832a-4b11-a72f-5ac4654ef3f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:48.065888 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-3e3d1006-832a-4b11-a72f-5ac4654ef3f7 admin admin] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:48.066355 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-3e3d1006-832a-4b11-a72f-5ac4654ef3f7 admin admin] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:48.066847 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-3e3d1006-832a-4b11-a72f-5ac4654ef3f7 admin admin] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:48.088117 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-3e3d1006-832a-4b11-a72f-5ac4654ef3f7 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090552 Aug 24 04:46:48.088699 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 24 04:46:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:46:59.369917 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:59.370967 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 24 04:46:59.371367 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:46:59.525658 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_cell0:SELECT=4 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:59.526430 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_cell1:SELECT=4 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:59.527082 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG dbcounter [-] [112382] Writing DB stats nova_api:SELECT=8 {{(pid=112382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:59.579156 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-415316e6-2f7e-4b9f-a8ae-35a9111c1e98 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:59.582157 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:59.582157 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: warnings.warn(msg) Aug 24 04:46:59.583243 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-415316e6-2f7e-4b9f-a8ae-35a9111c1e98 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:59.583722 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-415316e6-2f7e-4b9f-a8ae-35a9111c1e98 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:59.584214 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-415316e6-2f7e-4b9f-a8ae-35a9111c1e98 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:59.584942 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-415316e6-2f7e-4b9f-a8ae-35a9111c1e98 admin admin] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:59.585387 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-415316e6-2f7e-4b9f-a8ae-35a9111c1e98 admin admin] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:59.585805 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-415316e6-2f7e-4b9f-a8ae-35a9111c1e98 admin admin] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:59.611188 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-415316e6-2f7e-4b9f-a8ae-35a9111c1e98 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090415 Aug 24 04:46:59.611766 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 24 04:46:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:47:00.577850 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: DEBUG nova.api.openstack.wsgi [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] Calling method '>' {{(pid=112383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:00.578891 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: INFO nova.api.openstack.requestlog [None req-9701d6f6-9942-4510-9ba1-da15b931feb0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 24 04:47:00.579291 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: [pid: 112383|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 24 04:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:00.784757 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG nova.api.openstack.wsgi [None req-62e46f1f-6d10-4967-9a69-969b4bdd0cc3 admin admin] Calling method '>' {{(pid=112382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:00.787245 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:47:00.787245 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: warnings.warn(msg) Aug 24 04:47:00.788389 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-62e46f1f-6d10-4967-9a69-969b4bdd0cc3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:00.788922 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-62e46f1f-6d10-4967-9a69-969b4bdd0cc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:00.789330 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-62e46f1f-6d10-4967-9a69-969b4bdd0cc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:00.790076 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-62e46f1f-6d10-4967-9a69-969b4bdd0cc3 admin admin] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:00.790527 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-62e46f1f-6d10-4967-9a69-969b4bdd0cc3 admin admin] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:00.790952 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: DEBUG oslo_concurrency.lockutils [None req-62e46f1f-6d10-4967-9a69-969b4bdd0cc3 admin admin] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:00.813414 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: INFO nova.api.openstack.requestlog [None req-62e46f1f-6d10-4967-9a69-969b4bdd0cc3 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086764 Aug 24 04:47:00.814621 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: [pid: 112382|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 24 04:47:00 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:47:58.450997 dv-cinder-854264-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 04:47:58.451576 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: Wed Aug 24 04:47:58 2022 - graceful shutdown triggered... Aug 24 04:47:58.452014 dv-cinder-854264-1-iscsi devstack@n-api.service[112383]: Gracefully killing worker 2 (pid: 112383)... Aug 24 04:47:58.452580 dv-cinder-854264-1-iscsi devstack@n-api.service[112382]: Gracefully killing worker 1 (pid: 112382)... Aug 24 04:47:59.452349 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: worker 1 buried after 1 seconds Aug 24 04:47:59.452349 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: worker 2 buried after 1 seconds Aug 24 04:47:59.452349 dv-cinder-854264-1-iscsi devstack@n-api.service[112370]: goodbye to uWSGI. Aug 24 04:47:59.454066 dv-cinder-854264-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 04:47:59.454620 dv-cinder-854264-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 04:47:59.457570 dv-cinder-854264-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 04:47:59.468476 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:47:59 2022] *** Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: nodename: dv-cinder-854264-1-iscsi Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: machine: x86_64 Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: clock source: unix Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: pcre jit disabled Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: detected number of CPU cores: 4 Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: current working directory: / Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: your processes number limit is 47680 Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: your memory page size is 4096 bytes Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: detected max file descriptor number: 2048 Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: lock engine: pthread robust mutexes Aug 24 04:47:59.469045 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: thunder lock: enabled Aug 24 04:47:59.470222 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 04:47:59.470222 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:47:59.513635 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: Python main interpreter initialized at 0x55b9760809c0 Aug 24 04:47:59.513635 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: python threads support enabled Aug 24 04:47:59.513635 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: your server socket listen backlog is limited to 100 connections Aug 24 04:47:59.513635 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:47:59.514323 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:47:59.514323 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: *** Operational MODE: preforking *** Aug 24 04:47:59.514598 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:47:59.514598 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: spawned uWSGI master process (pid: 127403) Aug 24 04:47:59.514664 dv-cinder-854264-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 04:47:59.515187 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: spawned uWSGI worker 1 (pid: 127415, cores: 1) Aug 24 04:47:59.517782 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: spawned uWSGI worker 2 (pid: 127416, cores: 1) Aug 24 04:47:59.517782 dv-cinder-854264-1-iscsi devstack@n-api.service[127403]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:48:00.582617 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:48:00.607247 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:48:01.791410 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:48:01.791410 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: from cryptography.utils import int_from_bytes Aug 24 04:48:01.793107 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:48:01.793107 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: from cryptography.utils import int_from_bytes Aug 24 04:48:01.795519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:48:01.795519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: from cryptography.utils import int_from_bytes Aug 24 04:48:01.796073 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:48:01.796073 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: from cryptography.utils import int_from_bytes Aug 24 04:48:04.256990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:48:04.257685 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:48:04.257685 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:48:04.258114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:48:04.258320 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:48:04.258720 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.259040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.259363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.259683 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.260170 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.260480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.260803 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.261122 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.261448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.261709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.262044 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.262368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854264-1-iscsi {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.262688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.262998 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.263302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.263624 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.263927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.264244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.264544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.265051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.266331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.266331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.266331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.266604 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.266760 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.267059 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.267378 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.267686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.268008 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.268308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.268838 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854264-1-iscsi {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.269082 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.269931 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.270274 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.270697 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.271009 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.271326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.271645 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.271982 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.272290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.272613 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.272928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.273245 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.273560 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.273859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.274192 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.274502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.274816 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.275121 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.275419 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.275665 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.275967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.276284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.276602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.276921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.277168 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.277417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.277731 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.278071 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.278389 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.279530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.279530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.279530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.279864 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.280114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.280413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.280714 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.281030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.281341 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.281659 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.281961 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.282299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.283097 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.283097 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.283291 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.283612 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.283967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.284280 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.284856 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.285661 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.285972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.286303 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.286609 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.286928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.287261 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.287563 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.287811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.288128 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.288413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.288726 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.289117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.289350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.289642 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.289934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.290263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.290605 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.290867 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.291168 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.291490 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.291772 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.292190 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.292417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.292664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.292996 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.293294 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.293600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.294172 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.294263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.294495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.294811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.295110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.295410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.295731 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.296033 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.296331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.296644 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.296945 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.297244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.297554 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.297651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:48:04.298125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:48:04.298201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.298201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.298373 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:48:04.298453 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.298744 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:48:04.298881 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.299050 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:48:04.299187 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.299326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.299408 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.299609 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.299717 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.299903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.300016 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.300203 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.300400 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.300660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.300989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.301108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.301289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.301519 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.301722 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.302045 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.302222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.302222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.302484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.302611 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.302715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.302802 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.302887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.303128 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.303248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.303465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854264-1-iscsi {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.303639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.303794 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.303897 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.304112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.304214 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.304431 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.304594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.304756 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.304907 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.305068 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.305168 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.305397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.305495 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.305706 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.305813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.306048 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.306255 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.306362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.306572 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.306683 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.306882 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.306975 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.307198 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.307289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.307541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.307643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.307859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.307958 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.308169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.308258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.308485 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.308602 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.308796 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.308895 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.309122 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.309228 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.309437 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.309558 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.311278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.311998 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854264-1-iscsi {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.312104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.312201 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.312286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.312377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.312468 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.312582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.312704 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.312846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.312943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.313028 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.313112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.313195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.313295 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.313392 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.313477 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.313561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.313654 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.313752 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.313840 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.313936 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.314054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.314143 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.314242 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.314340 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.314426 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.314509 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.314600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.314691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.314785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.314879 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.314967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.315041 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.315131 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.315216 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.315306 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.315483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.315602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.315789 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.315933 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.316240 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.316593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.316722 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.316869 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.317183 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.317480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.317596 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.317904 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.318029 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.318211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.318302 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.318612 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.318720 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.318796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.318875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.319020 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.319144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.319405 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.319504 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.319724 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.319829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.320042 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.320181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.320354 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.320456 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.320667 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.320760 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.320981 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.321118 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.321291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.321424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.321600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.321763 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.321899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.322131 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.322248 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.322445 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.322569 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.322767 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.322896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.323164 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.323263 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.323475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.323574 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.323789 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.323915 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.324107 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.324200 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.324411 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.324504 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.324740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.324834 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.325051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.325142 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.325355 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.325461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.325677 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.325779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.325980 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.326143 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.326302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.326405 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.326616 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.326717 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.326922 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.327022 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.327228 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.327335 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.327536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.327636 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.327844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.327936 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.328115 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.328215 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.328420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.328581 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.328732 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.328826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.329053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.329156 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.329364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.329458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.329672 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.329774 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.329979 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.330130 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.330316 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.330413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.330625 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.330724 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.330925 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.331035 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.331229 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.331328 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.331530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.332159 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.332362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.332507 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.332638 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.332912 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.333015 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.333222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.333400 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.333524 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.333721 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.333814 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.334072 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.334182 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.334390 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.334497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.334723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.334821 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.335028 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.335129 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.335328 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.335428 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.335627 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.335719 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.335928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.336029 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.336250 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.336340 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.336559 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.336658 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.336869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.336963 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.337197 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.337300 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.337508 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.337622 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.337818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.337911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.338146 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.338251 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.338461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.338581 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.338768 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.338876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.339088 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.339228 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.339381 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.339487 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.339686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.339783 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.340003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.340102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.340309 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.340403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.340613 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.340712 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.340918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.341018 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.341223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.341314 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.341529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.341619 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.341834 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.341924 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.342154 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.342248 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.342510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.342615 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.342763 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.342855 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.343084 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.343187 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.343409 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.343503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.343722 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.343830 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.344027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.344126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.344331 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.344422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.344632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.344736 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:48:04.344938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.345031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.345244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.345336 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.345550 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.345652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.345862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.345961 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.346284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.346395 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.346606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.346712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.346915 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.347016 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.347313 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.347943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.348288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.348389 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.348637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.348874 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.348969 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.349207 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.349314 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.349532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.349622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.349855 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.349961 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.350207 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.350355 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.350520 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.350624 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.350858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.350965 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.351163 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.351271 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.351469 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.351605 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.352229 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.352360 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.352500 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.352679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.352771 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.352865 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.352951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.353042 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.353136 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.353229 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.353321 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.353406 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.353551 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.353697 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.353854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.354071 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.354184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.354392 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.354484 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.354729 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.354831 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.355060 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.355160 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.355368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.355468 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.355682 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.355786 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.355997 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.356098 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.356325 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.356424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.356664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.356757 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.356981 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.357130 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.357285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.357385 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.357610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.357708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.357914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.358061 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.358239 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.358333 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.358542 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.358642 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.358846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.358987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.359184 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.359358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.359490 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.359582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.359796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.359935 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.360110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.360239 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.360428 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.360561 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.360734 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.360829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.361045 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.361146 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.361353 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.361453 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.361661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.361751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.361972 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.362143 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.362307 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.362408 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.362612 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.362745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.363438 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.363556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.363790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.364024 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.364117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.364510 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.364671 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.364836 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.364955 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.365143 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.365236 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.365452 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.365555 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.365762 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.365863 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.366090 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.366187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.366401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.366513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.366759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.366872 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.367049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.367297 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.367389 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.367629 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.367731 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.367942 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.368042 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.368258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.368364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.368578 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.368679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.368892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.368986 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.369202 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.369304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.369514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.369606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.369838 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.369937 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.370182 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.370289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.370502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.370652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.370817 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.370920 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.371118 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.371219 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.371425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.371528 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.371734 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.371828 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.372036 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.372139 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.372338 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.372439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.372644 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.372788 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.372943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.373077 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.373242 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.373351 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.373541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.373642 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.373937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.374084 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.374274 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.374380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.374590 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.374690 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.374896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.374986 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.375195 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.375294 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.375500 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.375590 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.375807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.375953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.376110 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.376211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.376412 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.376511 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.376713 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.376805 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.377017 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.377117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.377327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.377463 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.377654 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.377747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.377966 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.378079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.378325 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.378417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.379179 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.379280 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.379620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.379745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.379947 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.380239 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.380333 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.380547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.380648 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.380850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.380950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.381161 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.381262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.381470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.381572 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.381772 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.381866 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.382104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.382244 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.382413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.382508 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.382721 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.382858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.383028 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.383156 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.383330 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.383432 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.383636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.383728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.383937 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.384037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.384249 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.384350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.384555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.384655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.384854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.384969 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.385152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.385301 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.385573 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.385743 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.385831 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.385925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.386131 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.386255 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.386360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.386577 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.386677 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.386927 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.387028 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.387241 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.387347 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.387541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.387634 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.387840 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.387941 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.388147 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.388247 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.388450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.388552 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.388748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.388841 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.389072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.389173 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.389380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.389487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.389679 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.389779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.389982 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.390146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.390306 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.390413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.390606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.390708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.390907 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.391034 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.391212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.391315 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.391529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.391623 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.391842 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.391941 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.392141 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.392330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.392447 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.392548 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.392747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.392840 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.393048 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.393176 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.393349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.393446 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.393653 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.393746 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.393951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.394083 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.394977 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.395108 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.395321 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.395537 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.395742 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.396004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.396098 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.396324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.396428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.396641 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.396781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.396964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.397094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.397285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.397388 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.397589 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.397683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.397904 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.398032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.398249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.398394 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.398573 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.398668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.398890 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.398992 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.399203 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.399305 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.399515 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.399611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.399824 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.399917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.400142 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.400235 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.400457 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.400563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.400759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.400860 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.401072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.401223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.401382 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.401476 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.401693 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.401792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.401993 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.402119 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.402314 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.402416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.402683 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.402776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.402993 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.403131 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.403316 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.403465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.403652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.403773 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.404215 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.404323 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.404533 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.404632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.404833 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.404932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.405141 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.405236 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.405450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.405554 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.405758 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.405859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.406095 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.406207 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.406405 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.406503 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.406712 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.406814 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.407020 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.407159 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.407330 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.407424 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.407636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.407730 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.407943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.408044 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.408248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.408349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.408576 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.408687 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.408864 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.408966 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.409171 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.409316 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.409488 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.409588 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.409888 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.410570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.410873 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.410981 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.411186 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.411440 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.411574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.411739 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.411835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.412084 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.412341 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.412529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.412691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.412845 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.413019 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.413162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.413349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.413496 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.413681 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.413785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.414067 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.414165 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.414385 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.414486 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.414698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.414791 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.415002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.415118 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.415420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.415530 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.415731 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.415834 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.416040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.416133 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.416349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.416482 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.416669 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.416772 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.416969 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.417062 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.417282 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.417435 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.417594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.417697 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.417913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.418038 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.418250 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.418352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.418561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.418710 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.418872 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.418988 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.419172 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.419263 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.419501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.419633 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.419800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.419916 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.420117 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.420212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.420426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.420520 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.420753 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.420919 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.421069 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.421228 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.421382 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.421518 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.421693 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.421841 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.422064 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.422175 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.422377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.422478 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.422691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.423036 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.423144 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.423370 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.423461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.423694 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.423828 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.424015 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.424111 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.424321 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.424415 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.424630 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.424724 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.424932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.425039 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.425247 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.425372 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.425598 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.425772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.426033 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.426242 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.426346 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.426776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.426883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.427091 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.427196 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.427400 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.427500 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.427722 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.427835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.428039 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.428147 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.428340 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.428432 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.428643 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.428745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.428951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.429053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.429253 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.429348 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.429554 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.429650 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.429875 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.430094 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.430184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.430269 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.430503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.430606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.430815 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.430909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.431123 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.431218 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.431424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.431525 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.431725 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.431827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.432033 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.432125 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.432331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.432434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.432652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.432745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.432962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.433061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.433271 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.433365 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.433588 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.433730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.433890 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.433990 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.434224 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.434335 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.434529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.434621 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.434833 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.434942 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.435134 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.435237 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.435437 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.435530 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.435759 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.435860 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.436068 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.436169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.436374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.436465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.436691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.436792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.437016 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.437117 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.437323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.437423 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.437632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.437732 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.437950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.438088 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.438287 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.438393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.438609 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.438709 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.438905 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.438999 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.439206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.439306 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.439505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.439606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.439810 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.439902 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.440107 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.440200 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.440413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.440506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.440711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.440813 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.441556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.441662 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.442022 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.442172 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.442385 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.442597 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.442700 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.442927 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.443027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.443244 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.443347 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.443607 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.443716 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.443912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.444038 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.444214 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.444313 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.444530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.444625 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.444871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.445231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.445616 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.445795 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.445969 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.446309 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.446492 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.446655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.446822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.446982 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.447142 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.447293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.447469 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.447643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.447810 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.447963 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.448114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.448273 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.448439 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.448591 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.448750 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.448903 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.449054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.449161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.449299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.449590 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.449908 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.450061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.450267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.450398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.450596 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.450738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.450930 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.451023 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.451243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.451563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.451724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.451884 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.451975 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.452201 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.452339 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.452519 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.452617 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.452835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.452934 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.453148 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.453320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.453458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.453552 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.453766 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.453868 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.454098 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.454216 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.454410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.454513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.454717 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.454811 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.455040 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.455182 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.455358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.455452 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.455683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.455793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.456006 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.456107 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.456323 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.456414 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.456666 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.457381 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.457539 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.457849 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.458124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.458234 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.458546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.458651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.458864 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.458966 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.459238 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.459403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.459586 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.459694 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.459905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.460051 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.460220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.460325 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.460539 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.460648 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.460846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.460940 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.461222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.461340 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.461470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.461575 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.461784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.461889 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.462112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.462233 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.462426 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.462560 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.462736 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.462860 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.463059 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.463182 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.463393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.463487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.463711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.463811 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.464021 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.464114 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.464362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.464475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.464648 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.464750 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.465014 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.465185 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.465331 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.465494 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.465643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.465822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.465956 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.466435 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.466576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.466761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.466835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.467029 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.467133 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.467343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.467444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.467730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.467869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.468033 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.468164 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.468339 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.468461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.468645 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.468768 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.468947 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.469081 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.469267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.469397 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.469668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.469799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.469922 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.470107 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.470240 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.470354 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.470547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.470669 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.470902 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.471190 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.471318 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.471526 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.471645 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.471838 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.471980 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.472169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.472800 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.473075 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.473212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.473479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.473642 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.473805 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.474080 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.474231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.474457 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.474763 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.475081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.475394 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.475644 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.475764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.475988 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.476299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.476608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.476858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.477117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.477296 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.477459 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.477630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.477839 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.478111 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.478214 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.478303 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.478404 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.478492 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.478687 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.478823 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.478988 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.479143 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.479299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.479461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.479601 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.479797 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.479949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.480130 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.480236 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.480439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.480542 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.480765 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.480861 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.481068 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.481240 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.481394 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.481540 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.481688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.481896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.482043 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.482162 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.482351 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.482684 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.483012 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.483344 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.483899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.484105 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.484264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.484482 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.484602 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.484715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.484838 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.484951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.485070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.485184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.485297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.485520 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.485652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.485853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.485983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.486203 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.486337 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.486546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.487102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.487102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.487407 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.487530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.487670 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.487799 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.488051 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.488678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.488793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.488793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.489012 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.489268 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.489391 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.489639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.489766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.490054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.490186 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.490360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.490468 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.490670 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.490772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.490978 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.491082 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.491285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.491380 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.491672 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.491780 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.491972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.492086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.492243 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.492378 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.492584 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.492685 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.492854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.492958 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.493160 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.493252 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.493467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.493567 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.493776 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.493881 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.494107 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.494233 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.494424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.494656 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.494829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.494977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.495111 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.495252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.495395 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.495550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.495728 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.495880 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.496021 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.496160 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.496311 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.496451 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.496613 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.496798 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.497250 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.497401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.497522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.497683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.497839 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.497993 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.498244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.498400 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.498524 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.498651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.498789 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.498951 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.499107 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.499253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.499368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.499467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.499554 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.499646 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.499732 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.499817 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.499930 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.500141 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.500399 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.500495 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.500600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.500848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.500952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.501165 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.501258 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.501479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.501573 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.501790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.501917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.502141 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.502239 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.502466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.502582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.502770 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.502885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.503084 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.503176 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.503388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.503524 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.503748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.503934 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.504088 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.504354 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.504489 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.504719 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.504836 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.505079 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.505174 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.505415 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.505508 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.505714 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.505819 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.506037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.506136 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.506359 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.506462 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.506664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.506766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.506963 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.507130 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.507304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.507405 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.507667 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.507782 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.507972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.508073 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.508288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.508448 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.508602 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.508698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.508905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.509037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.509206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.509328 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.509503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.509598 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.509810 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.509911 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.510133 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.510288 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.510428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.510652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.510745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.510818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.511010 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.511118 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.511327 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.511411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.511640 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.511733 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.511939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.512070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.512237 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.512358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.512537 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.512675 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.512869 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.512998 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.513216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.513346 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.513547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.513785 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.513921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.514135 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.514260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.514485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.514635 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.514803 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.514942 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.515110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.515240 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.515430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.515559 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.515751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.515872 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.516067 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.516195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.516376 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.516496 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.516695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.516809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.516989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.517109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.517302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.517429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.517609 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.517846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.517970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.518169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.518284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.518405 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.518533 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.518655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.518843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.518965 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.519284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.519420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.519780 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.520112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.520366 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.520498 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.520758 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.520880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.521056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.521200 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.521378 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.521480 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.521704 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.521844 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.522039 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.522138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.522351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.522446 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.522751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.522859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.522955 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.523050 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.523258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.523359 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.523569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.523664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.523876 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.523971 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.524186 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.524279 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.524491 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.524631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.524801 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.524906 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.525117 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.525208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.525427 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.525536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.525730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.525829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.526062 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.526175 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.526388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.526486 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.526697 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.526796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.527007 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.527113 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.527315 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.527408 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.527630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.527731 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.527945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.528083 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.528258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.528363 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.528556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.528657 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.528796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:48:04.528907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.529417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.529810 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.530064 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.530376 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.530693 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.531003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.531316 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.531623 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.531952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.532264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.532623 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.532948 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.533263 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.533590 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.533905 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.534246 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.534604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.535452 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.536366 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.536712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.537042 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.537388 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.537788 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.538092 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.538378 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.538690 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.539020 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.539441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.539653 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.539977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.540290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.540613 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.540913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.541235 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.541540 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.541854 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.542194 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.542511 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.542825 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.543139 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.543450 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.543774 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.544239 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.544467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.544771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.546252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.546252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.546252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.546252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.547799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.547799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.547799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.547799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.547799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.548146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.548482 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.548777 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.549154 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.549531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.549881 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.550443 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.551402 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.551773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.552251 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.552605 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.552856 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.553342 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.553594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.553921 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.554380 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.554629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.554943 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.555301 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.555697 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.556030 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.556374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.556691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.557019 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.557359 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.557719 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.558216 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.558504 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.558815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.559127 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.559483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.559839 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.560153 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.560543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.560853 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.561218 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.561570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.561884 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.562294 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.562615 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.563090 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.563394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.563742 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.564067 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.564400 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.564786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.565132 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.565497 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.565877 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.566432 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.567023 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.567525 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.567818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.568729 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.568729 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.568907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.569149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.569471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.569869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.570257 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.570680 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.570932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.571312 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.571880 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.572388 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.572874 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.573394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.573884 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.574447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.574991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.575471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.575998 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.576530 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.577090 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.577744 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.577991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.578344 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.578701 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.579057 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.579446 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.579769 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.580148 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.580492 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.580902 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.581224 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.581614 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.581984 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.582625 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.583032 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.583350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:48:04.583608 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:48:04.596268 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO dbcounter [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Registered counter for database nova_api Aug 24 04:48:04.618837 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_db.sqlalchemy.engines [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:48:04.625874 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writer thread running {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:48:04.661680 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO dbcounter [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Registered counter for database nova_api Aug 24 04:48:04.683141 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_db.sqlalchemy.engines [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:48:04.687601 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.context [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1da3d3a-d71f-44a7-9bcc-c0c528eed093(cell1) {{(pid=127415) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:48:04.691672 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writer thread running {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:48:04.692668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:04.693088 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:04.694697 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:04.695469 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:04.695912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:04.697921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:04.700024 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO dbcounter [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Registered counter for database nova_cell0 Aug 24 04:48:04.704593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO dbcounter [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Registered counter for database nova_cell1 Aug 24 04:48:04.714065 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_db.sqlalchemy.engines [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:48:04.717123 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_db.sqlalchemy.engines [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:48:04.725300 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writer thread running {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:48:04.767604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.context [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1da3d3a-d71f-44a7-9bcc-c0c528eed093(cell1) {{(pid=127416) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:48:04.772824 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:04.773312 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:04.774954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:04.775715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:04.776166 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:04.778231 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:04.780722 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO dbcounter [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Registered counter for database nova_cell0 Aug 24 04:48:04.786302 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO dbcounter [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Registered counter for database nova_cell1 Aug 24 04:48:04.793937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_db.sqlalchemy.engines [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:48:04.799464 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writer thread running {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:48:04.802515 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_db.sqlalchemy.engines [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:48:04.875148 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writer thread running {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:48:04.886691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO dbcounter [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Registered counter for database nova_cell0 Aug 24 04:48:04.894147 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_db.sqlalchemy.engines [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:48:04.899517 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writer thread running {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:48:04.962137 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writer thread running {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:48:04.972245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO dbcounter [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Registered counter for database nova_cell0 Aug 24 04:48:04.981945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_db.sqlalchemy.engines [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:48:04.988752 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writer thread running {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:48:05.230942 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: WARNING keystonemiddleware.auth_token [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:48:05.239874 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: WARNING keystonemiddleware.auth_token [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:48:05.334661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: WARNING keystonemiddleware.auth_token [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:48:05.342195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: WARNING keystonemiddleware.auth_token [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:48:05.589695 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: WARNING keystonemiddleware.auth_token [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:48:05.597017 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: WARNING keystonemiddleware.auth_token [None req-55f91774-5cba-4cc3-9617-66f1a0978c9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:48:05.603003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9760809c0 pid: 127415 (default app) Aug 24 04:48:05.694841 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: WARNING keystonemiddleware.auth_token [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:48:05.700861 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: WARNING keystonemiddleware.auth_token [None req-bd9aa735-67e1-4182-baa6-94930750ee8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:48:05.706267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9760809c0 pid: 127416 (default app) Aug 24 04:48:40.992494 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=3 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:40.994416 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=3 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:40.995236 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=3 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:40.995954 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=3 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:42.415686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-203e55ce-2d0a-4ff3-aef2-3e99ff85e090 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] Action: 'create', calling method: .version_select at 0x7fb0529495e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-90409324", "metadata": {"Type": "work"}}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:45.206542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d0a3c00f-de5a-4aaf-ac80-4dc2fc6d66a8 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb052a77ca0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:45.270360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-203e55ce-2d0a-4ff3-aef2-3e99ff85e090 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 4.294272 Aug 24 04:48:45.271023 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 24 04:48:40 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 4297 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 04:48:45.286875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=3 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:45.288824 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=3 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:45.292148 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-83f39e5f-ae00-4e94-b538-a02f66185951 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] Calling method '.version_select at 0x7fb05281d4c0>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:45.294904 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=3 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:45.295918 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=3 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:45.391675 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-83f39e5f-ae00-4e94-b538-a02f66185951 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c" status: 200 len: 351 microversion: 2.1 time: 0.106375 Aug 24 04:48:45.398630 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 2/2] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:48:45 2022] GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:45.899620 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d0a3c00f-de5a-4aaf-ac80-4dc2fc6d66a8 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/67dd03af-59a6-4c22-bb78-9b039cab7a7c" status: 200 len: 351 microversion: 2.1 time: 1.079426 Aug 24 04:48:45.900202 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 1/3] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:48:44 2022] GET /compute/v2.1/os-volumes/67dd03af-59a6-4c22-bb78-9b039cab7a7c => generated 351 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:46.407565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2070c446-6a53-40bc-be93-33f5ce4e01a2 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] Calling method '.version_select at 0x7fb05281dc10>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:46.586187 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2070c446-6a53-40bc-be93-33f5ce4e01a2 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c" status: 200 len: 352 microversion: 2.1 time: 0.182517 Aug 24 04:48:46.589658 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:48:46 2022] GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c => generated 352 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:46.601985 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5ffd50b3-c3c7-4cea-b1f3-819166c27068 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] Calling method '.version_select at 0x7fb0528535e0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:46.724258 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5ffd50b3-c3c7-4cea-b1f3-819166c27068 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c" status: 200 len: 352 microversion: 2.1 time: 0.127716 Aug 24 04:48:46.724827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 2/5] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:48:46 2022] GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:46.749126 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-946f468c-debd-40e7-a6b5-2295b2e3586f tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] Calling method '.version_select at 0x7fb052837310>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:47.021354 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-946f468c-debd-40e7-a6b5-2295b2e3586f tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c" status: 202 len: 0 microversion: 2.1 time: 0.276541 Aug 24 04:48:47.022058 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 4/6] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:48:46 2022] DELETE /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:48:47.033749 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b18bf465-b9c2-4197-b1ce-b92c86be5862 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] Calling method '.version_select at 0x7fb052853670>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:47.130764 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b18bf465-b9c2-4197-b1ce-b92c86be5862 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c" status: 200 len: 351 microversion: 2.1 time: 0.103761 Aug 24 04:48:47.132011 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 3/7] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:48:47 2022] GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:47.841506 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-338832aa-9a7b-4b5d-9b40-347d95168704 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb05281dc10>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:47.928956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-338832aa-9a7b-4b5d-9b40-347d95168704 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8649cb2e-b329-4826-be5e-60c2b304949a" status: 200 len: 350 microversion: 2.1 time: 0.091281 Aug 24 04:48:47.929892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:48:47 2022] GET /compute/v2.1/os-volumes/8649cb2e-b329-4826-be5e-60c2b304949a => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:48.147242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ff4d97e0-71b4-4c5f-b764-9859b11de6b4 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] Calling method '.version_select at 0x7fb052853dc0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:48.209179 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-ff4d97e0-71b4-4c5f-b764-9859b11de6b4 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] HTTP exception thrown: Volume 65e22eea-f95f-448f-8e80-e0a195abea8c could not be found. Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ff4d97e0-71b4-4c5f-b764-9859b11de6b4 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] Request method failure captured: Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c HTTP/1.1 Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa2o-EePX1rb1cJu3MC6ENGDI6InIJ3MBmwuJvqdsOFMM3x7yJj_cQvrMKGPWxs_6QTcsVk6nns3B9He8_83HzjisXTvRZUtLYRSbvaYoTQ_bxobw0GszIXjKRbsJpNvfWLkxGSpS5cUaYnb9VdCLnMy4-h4FCbL7bPw_H2O4qj4mLE Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 4eee8e7b7b87462c86bb9c37400011ce Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-VolumesGetTestJSON-1612991877 Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:48:48.215225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4eee8e7b7b87462c86bb9c37400011ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4eee8e7b7b87462c86bb9c37400011ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4eee8e7b7b87462c86bb9c37400011ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4eee8e7b7b87462c86bb9c37400011ce"}]}] Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-VolumesGetTestJSON-1612991877 Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 4eee8e7b7b87462c86bb9c37400011ce Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-VolumesGetTestJSON-1612991877 Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-VolumesGetTestJSON-1612991877-project Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 6978f455549a49e69c254eafa9248f29 Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-VolumesGetTestJSON-1612991877-project Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Volume 65e22eea-f95f-448f-8e80-e0a195abea8c could not be found. Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '65e22eea-f95f-448f-8e80-e0a195abea8c'} Aug 24 04:48:48.216321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65e22eea-f95f-448f-8e80-e0a195abea8c could not be found. (HTTP 404) (Request-ID: req-ba3ed2db-b71d-4eca-952e-b5141c24f1ec) Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:48:48.217234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:48:48.218144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65e22eea-f95f-448f-8e80-e0a195abea8c could not be found. Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:48:48.219003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65e22eea-f95f-448f-8e80-e0a195abea8c could not be found. Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65e22eea-f95f-448f-8e80-e0a195abea8c could not be found. Aug 24 04:48:48.224003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:48:48.229046 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ff4d97e0-71b4-4c5f-b764-9859b11de6b4 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] Returning 404 to user: Volume 65e22eea-f95f-448f-8e80-e0a195abea8c could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:48:48.230332 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ff4d97e0-71b4-4c5f-b764-9859b11de6b4 tempest-VolumesGetTestJSON-1612991877 tempest-VolumesGetTestJSON-1612991877-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c" status: 404 len: 109 microversion: 2.1 time: 0.089405 Aug 24 04:48:48.232659 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 4/9] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:48:48 2022] GET /compute/v2.1/os-volumes/65e22eea-f95f-448f-8e80-e0a195abea8c => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:48:49.683407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0021c84d-2e3a-4843-9a25-846e8c2c4913 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb05281d430>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:49.749555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0021c84d-2e3a-4843-9a25-846e8c2c4913 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d7d11e00-9edb-4ca5-8661-97b844179362" status: 200 len: 350 microversion: 2.1 time: 0.071926 Aug 24 04:48:49.750131 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 6/10] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:48:49 2022] GET /compute/v2.1/os-volumes/d7d11e00-9edb-4ca5-8661-97b844179362 => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:49.764299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-01632d8a-b982-4017-b9b1-f017d2f3ea9c tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb05281ce50>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:49.897770 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-01632d8a-b982-4017-b9b1-f017d2f3ea9c tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.138268 Aug 24 04:48:49.899481 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 5/11] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Aug 24 04:48:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:48:49.916454 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1ca39625-dd7d-4f20-af99-65036d856cf5 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb0528373a0>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:50.113848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1ca39625-dd7d-4f20-af99-65036d856cf5 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.201179 Aug 24 04:48:50.114538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 7/12] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Aug 24 04:48:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:50.132081 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8cfa8025-4e8c-4b38-b1d4-8b97b3ca5633 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb05281caf0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:50.339646 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8cfa8025-4e8c-4b38-b1d4-8b97b3ca5633 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.211666 Aug 24 04:48:50.340798 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 6/13] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Aug 24 04:48:50 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:50.353933 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-fd570d03-292a-4984-bb79-7bf98416326c tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb052837e50>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:50.531745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-fd570d03-292a-4984-bb79-7bf98416326c tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.181073 Aug 24 04:48:50.534052 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 8/14] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Aug 24 04:48:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:50.560495 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1b033f69-5648-4f14-af34-27e4c2e901b4 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb0527fdb80>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:50.748695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1b033f69-5648-4f14-af34-27e4c2e901b4 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.192169 Aug 24 04:48:50.760547 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 7/15] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Aug 24 04:48:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:50.765078 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e23f9300-f6f7-4772-a5c2-c3eeff060b38 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb05281d550>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:50.981715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e23f9300-f6f7-4772-a5c2-c3eeff060b38 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.220333 Aug 24 04:48:50.991675 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 9/16] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Aug 24 04:48:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:50.996077 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-87c243a5-601e-434f-8faa-2a1d23221bc4 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb052792dc0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:51.147285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-87c243a5-601e-434f-8faa-2a1d23221bc4 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.155088 Aug 24 04:48:51.161004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 8/17] 10.222.0.60 () {58 vars in 1188 bytes} [Wed Aug 24 04:48:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:51.163920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-cd6bd32f-fab9-457d-812b-b1c580c54a39 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] Calling method '.version_select at 0x7fb05283d8b0>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:51.365589 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-cd6bd32f-fab9-457d-812b-b1c580c54a39 tempest-VolumesTestJSON-1984613750 tempest-VolumesTestJSON-1984613750-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.205832 Aug 24 04:48:51.366220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 10/18] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Aug 24 04:48:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:53.541247 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-576951230", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:53.754487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] validate_networks() for [('49966c4c-33d7-4d8c-a6cd-288757accecd', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:48:56.290055 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:48:56.290823 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:48:56.291044 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:48:56.291571 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:48:56.292000 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:48:56.320626 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:56.323812 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:56.324685 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:56.326085 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:56.329444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:56.331101 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:56.422732 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Getting quotas for project 1a1f238eb4f34d44ac93b85181ad7001. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:48:56.449335 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Getting quotas for user 3d5408f9ada24654839e479c7fe385ce and project 1a1f238eb4f34d44ac93b85181ad7001. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:48:56.489880 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:48:56.496463 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:48:56.749423 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-6877776d-c086-4ec7-8fb3-1eb4c0c87805 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.787826 Aug 24 04:48:56.750690 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 9/19] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:48:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 3790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:48:56.765409 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1b296c50-8cf9-4146-854a-8f2a622f52a0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:56.767104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1b296c50-8cf9-4146-854a-8f2a622f52a0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:56.996982 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1b296c50-8cf9-4146-854a-8f2a622f52a0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:57.023018 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1b296c50-8cf9-4146-854a-8f2a622f52a0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1221 microversion: 2.1 time: 0.263666 Aug 24 04:48:57.026323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 11/20] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:56 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1221 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:48:57.281897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-919548218", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:57.413304 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] validate_networks() for [('49966c4c-33d7-4d8c-a6cd-288757accecd', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:48:58.514580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:48:58.516154 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:48:58.517009 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:48:58.517776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:48:58.518441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:48:58.536961 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:58.542102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:58.542815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:58.543873 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:58.546908 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:58.547730 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:58.598734 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Getting quotas for project 1a1f238eb4f34d44ac93b85181ad7001. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:48:58.611274 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Getting quotas for user 3d5408f9ada24654839e479c7fe385ce and project 1a1f238eb4f34d44ac93b85181ad7001. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:48:58.660393 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:48:58.671201 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:48:58.870974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-94e198e2-1439-44bb-8df6-32714ecc87be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.593747 Aug 24 04:48:58.887576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 10/21] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:48:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:48:58.923611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-bd0cbe3c-ea2c-4a6e-bffc-44af2ecb4c1a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:58.925159 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-bd0cbe3c-ea2c-4a6e-bffc-44af2ecb4c1a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:59.192067 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-bd0cbe3c-ea2c-4a6e-bffc-44af2ecb4c1a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:59.207460 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-bd0cbe3c-ea2c-4a6e-bffc-44af2ecb4c1a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1221 microversion: 2.1 time: 0.313293 Aug 24 04:48:59.223420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 12/22] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:58 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1221 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:00.243842 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fa834ebc-7496-4939-86c6-020264087ef4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:00.244544 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-fa834ebc-7496-4939-86c6-020264087ef4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:00.585162 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-fa834ebc-7496-4939-86c6-020264087ef4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:00.619033 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-fa834ebc-7496-4939-86c6-020264087ef4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1221 microversion: 2.1 time: 0.384523 Aug 24 04:49:00.624324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:00 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1221 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:01.658578 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:01.659255 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:01.683968 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:01.684690 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:01.685302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:01.690456 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:01.694769 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:01.694769 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:02.364322 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:02.405160 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8f698298-ddaa-4bf1-9049-befc003e41e8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1273 microversion: 2.1 time: 0.752665 Aug 24 04:49:02.411029 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 13/24] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:01 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1273 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:03.431960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:03.432622 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:03.457129 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:03.460668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:03.461973 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:03.467757 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:03.469290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:03.470868 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:03.929469 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5fe388bf-bbd7-4899-928a-94a97ce68fa3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'create', calling method: .version_select at 0x7fb051ea2310>, body: {"keypair": {"name": "tempest-keypair-1969204994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDNceb1VJs3pTAjbh48rXlO26p7Cc5EqUErse+e+/2Y2Nw4+7hHTs17ZtWL2i3TYDVlu3e+gIx1Sp+rPLp6yhSmym2/JuZChhJvx2gOJnW1BBnxO9uR6CijBZDTQUHXuw=="}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:04.004574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:04.030603 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6b92c6cd-793d-4387-9733-e434735f44f0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1279 microversion: 2.1 time: 0.599362 Aug 24 04:49:04.033713 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 14/25] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:03 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1279 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:04.059678 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-5fe388bf-bbd7-4899-928a-94a97ce68fa3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Getting quotas for project 02571d09157b409a8bd4737acd07c5de. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:49:04.080570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-5fe388bf-bbd7-4899-928a-94a97ce68fa3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Getting quotas for user 7c5112136c7947e3ac99949d330ba0be and project 02571d09157b409a8bd4737acd07c5de. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:49:04.210754 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5fe388bf-bbd7-4899-928a-94a97ce68fa3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.955950 Aug 24 04:49:04.212106 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 12/26] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Aug 24 04:49:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 958 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 04:49:04.278349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f63f2426-fc2d-4f2d-bf77-433999e666b2 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Action: 'create', calling method: .version_select at 0x7fb05271f8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-695464672", "metadata": {"Type": "work"}}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f63f2426-fc2d-4f2d-bf77-433999e666b2 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Request method failure captured: Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 121 Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa2_iYm2tjxsDnkDQFo2hopGeCxz0aWUu6RJNwBmAf-DJ26jAKKiv8Qioq3s_qx8EVcpjhcVcBJb82gUDkeuU9oMYhiIoa29MZHGNbqWcJrQ4y71rVzZ9ABlEvAloRehdOfL7pXNWcLACNHWBfyC-cgc9buveQZAatD82sT5SHWQG6k Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:49:04.289184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fd1df89df7b446ef807a3a89bba84cb2"}]}] Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: edc4b43dbee046dfb998d6ebc2b7bab1 Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-695464672", "metadata": {"Type": "work"}}} Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: Aug 24 04:49:04.291056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-695464672', 'metadata': {'Type': 'work'}}}} Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:49:04.291932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:49:04.293567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:49:04.294715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 04:49:04.294715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.299849 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f63f2426-fc2d-4f2d-bf77-433999e666b2 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:49:04.301114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f63f2426-fc2d-4f2d-bf77-433999e666b2 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.265469 Aug 24 04:49:04.301801 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 15/27] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 24 04:49:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:49:04.313774 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e7f73336-da3a-4a8c-9dd3-77acd67b2c0b tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Action: 'create', calling method: .version_select at 0x7fb051657700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2049458857", "metadata": {"Type": "work"}}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e7f73336-da3a-4a8c-9dd3-77acd67b2c0b tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Request method failure captured: Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 120 Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa2_iYm2tjxsDnkDQFo2hopGeCxz0aWUu6RJNwBmAf-DJ26jAKKiv8Qioq3s_qx8EVcpjhcVcBJb82gUDkeuU9oMYhiIoa29MZHGNbqWcJrQ4y71rVzZ9ABlEvAloRehdOfL7pXNWcLACNHWBfyC-cgc9buveQZAatD82sT5SHWQG6k Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:49:04.319475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fd1df89df7b446ef807a3a89bba84cb2"}]}] Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: edc4b43dbee046dfb998d6ebc2b7bab1 Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2049458857", "metadata": {"Type": "work"}}} Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: Aug 24 04:49:04.320604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2049458857', 'metadata': {'Type': 'work'}}}} Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi '0' Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:49:04.321266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:49:04.322640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:49:04.323576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 04:49:04.323576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.331654 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e7f73336-da3a-4a8c-9dd3-77acd67b2c0b tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:49:04.332679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e7f73336-da3a-4a8c-9dd3-77acd67b2c0b tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024941 Aug 24 04:49:04.337573 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 13/28] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 24 04:49:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:49:04.347548 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9faecfbe-a0f5-45dd-9d49-cb35721e3aab tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Action: 'create', calling method: .version_select at 0x7fb0526d8d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-87637862", "metadata": {"Type": "work"}}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9faecfbe-a0f5-45dd-9d49-cb35721e3aab tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Request method failure captured: Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 117 Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa2_iYm2tjxsDnkDQFo2hopGeCxz0aWUu6RJNwBmAf-DJ26jAKKiv8Qioq3s_qx8EVcpjhcVcBJb82gUDkeuU9oMYhiIoa29MZHGNbqWcJrQ4y71rVzZ9ABlEvAloRehdOfL7pXNWcLACNHWBfyC-cgc9buveQZAatD82sT5SHWQG6k Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:49:04.367455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fd1df89df7b446ef807a3a89bba84cb2"}]}] Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: edc4b43dbee046dfb998d6ebc2b7bab1 Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-87637862", "metadata": {"Type": "work"}}} Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: Aug 24 04:49:04.368948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-87637862', 'metadata': {'Type': 'work'}}}} Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi '' Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:49:04.369718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:49:04.371152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:49:04.372350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 04:49:04.372350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.373522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9faecfbe-a0f5-45dd-9d49-cb35721e3aab tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:49:04.375573 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9faecfbe-a0f5-45dd-9d49-cb35721e3aab tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032529 Aug 24 04:49:04.379781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 16/29] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 24 04:49:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:49:04.394351 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d16bae91-400a-46b5-9dea-678fecde9011 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Calling method '.version_select at 0x7fb051ea2c10>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:04.480144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-d16bae91-400a-46b5-9dea-678fecde9011 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] HTTP exception thrown: Volume tempest-invalid-258318571 could not be found. Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d16bae91-400a-46b5-9dea-678fecde9011 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Request method failure captured: Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-258318571 HTTP/1.1 Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa2_iYm2tjxsDnkDQFo2hopGeCxz0aWUu6RJNwBmAf-DJ26jAKKiv8Qioq3s_qx8EVcpjhcVcBJb82gUDkeuU9oMYhiIoa29MZHGNbqWcJrQ4y71rVzZ9ABlEvAloRehdOfL7pXNWcLACNHWBfyC-cgc9buveQZAatD82sT5SHWQG6k Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:49:04.487945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fd1df89df7b446ef807a3a89bba84cb2"}]}] Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: edc4b43dbee046dfb998d6ebc2b7bab1 Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Volume tempest-invalid-258318571 could not be found. Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': 'tempest-invalid-258318571'} Aug 24 04:49:04.489370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-258318571 could not be found. (HTTP 404) (Request-ID: req-94ba3a1b-9149-426c-bf68-1c18e271aea7) Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.490299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:49:04.491364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-258318571 could not be found. Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:49:04.492285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-258318571 could not be found. Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-258318571 could not be found. Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d16bae91-400a-46b5-9dea-678fecde9011 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Returning 404 to user: Volume tempest-invalid-258318571 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:49:04.493281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d16bae91-400a-46b5-9dea-678fecde9011 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-258318571" status: 404 len: 98 microversion: 2.1 time: 0.108410 Aug 24 04:49:04.494807 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 14/30] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Aug 24 04:49:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-258318571 => generated 98 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:49:04.503338 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-15071c53-c3bb-48ca-b47d-dcd656db94c8 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004629 Aug 24 04:49:04.504870 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 17/31] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Aug 24 04:49:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 04:49:04.518740 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e2a0cf8c-9cd0-4f49-ba82-3f6173305fbf tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008277 Aug 24 04:49:04.520123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 15/32] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Aug 24 04:49:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 04:49:04.531776 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-24a2b04b-4138-43d7-b4c3-c1619dd5a7c4 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Calling method '.version_select at 0x7fb052739ee0>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:04.599743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-24a2b04b-4138-43d7-b4c3-c1619dd5a7c4 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] HTTP exception thrown: Volume 988fd925-3000-4668-88e3-c7aca9d15248 could not be found. Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-24a2b04b-4138-43d7-b4c3-c1619dd5a7c4 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Request method failure captured: Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: DELETE /compute/v2.1/os-volumes/988fd925-3000-4668-88e3-c7aca9d15248 HTTP/1.1 Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa2_iYm2tjxsDnkDQFo2hopGeCxz0aWUu6RJNwBmAf-DJ26jAKKiv8Qioq3s_qx8EVcpjhcVcBJb82gUDkeuU9oMYhiIoa29MZHGNbqWcJrQ4y71rVzZ9ABlEvAloRehdOfL7pXNWcLACNHWBfyC-cgc9buveQZAatD82sT5SHWQG6k Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:49:04.605465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fd1df89df7b446ef807a3a89bba84cb2"}]}] Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: edc4b43dbee046dfb998d6ebc2b7bab1 Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Volume 988fd925-3000-4668-88e3-c7aca9d15248 could not be found. Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '988fd925-3000-4668-88e3-c7aca9d15248'} Aug 24 04:49:04.607403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 988fd925-3000-4668-88e3-c7aca9d15248 could not be found. (HTTP 404) (Request-ID: req-08ea8706-3e8e-4bdc-b0ab-faeab9ae3e2b) Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.608248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:49:04.609424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 988fd925-3000-4668-88e3-c7aca9d15248 could not be found. Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 04:49:04.611117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 988fd925-3000-4668-88e3-c7aca9d15248 could not be found. Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 988fd925-3000-4668-88e3-c7aca9d15248 could not be found. Aug 24 04:49:04.613847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.616684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-24a2b04b-4138-43d7-b4c3-c1619dd5a7c4 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Returning 404 to user: Volume 988fd925-3000-4668-88e3-c7aca9d15248 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:49:04.618162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-24a2b04b-4138-43d7-b4c3-c1619dd5a7c4 tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/988fd925-3000-4668-88e3-c7aca9d15248" status: 404 len: 109 microversion: 2.1 time: 0.092813 Aug 24 04:49:04.618904 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 18/33] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:49:04 2022] DELETE /compute/v2.1/os-volumes/988fd925-3000-4668-88e3-c7aca9d15248 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:49:04.632603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4b375c25-d087-48a3-b33b-38d1e15e4c1d tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Calling method '.version_select at 0x7fb05166a550>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:04.706236 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-4b375c25-d087-48a3-b33b-38d1e15e4c1d tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] HTTP exception thrown: Volume 1c024b3d-23de-443b-9f73-57ee748bfa6d could not be found. Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4b375c25-d087-48a3-b33b-38d1e15e4c1d tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Request method failure captured: Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/os-volumes/1c024b3d-23de-443b-9f73-57ee748bfa6d HTTP/1.1 Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa2_iYm2tjxsDnkDQFo2hopGeCxz0aWUu6RJNwBmAf-DJ26jAKKiv8Qioq3s_qx8EVcpjhcVcBJb82gUDkeuU9oMYhiIoa29MZHGNbqWcJrQ4y71rVzZ9ABlEvAloRehdOfL7pXNWcLACNHWBfyC-cgc9buveQZAatD82sT5SHWQG6k Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:49:04.713757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fd1df89df7b446ef807a3a89bba84cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fd1df89df7b446ef807a3a89bba84cb2"}]}] Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: fd1df89df7b446ef807a3a89bba84cb2 Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-VolumesNegativeTest-1923120968 Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: edc4b43dbee046dfb998d6ebc2b7bab1 Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-VolumesNegativeTest-1923120968-project Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Volume 1c024b3d-23de-443b-9f73-57ee748bfa6d could not be found. Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '1c024b3d-23de-443b-9f73-57ee748bfa6d'} Aug 24 04:49:04.715031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1c024b3d-23de-443b-9f73-57ee748bfa6d could not be found. (HTTP 404) (Request-ID: req-75b7dea8-1293-4e62-9e30-c5d156659365) Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.715829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:49:04.730699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1c024b3d-23de-443b-9f73-57ee748bfa6d could not be found. Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:49:04.731655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1c024b3d-23de-443b-9f73-57ee748bfa6d could not be found. Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1c024b3d-23de-443b-9f73-57ee748bfa6d could not be found. Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4b375c25-d087-48a3-b33b-38d1e15e4c1d tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] Returning 404 to user: Volume 1c024b3d-23de-443b-9f73-57ee748bfa6d could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4b375c25-d087-48a3-b33b-38d1e15e4c1d tempest-VolumesNegativeTest-1923120968 tempest-VolumesNegativeTest-1923120968-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1c024b3d-23de-443b-9f73-57ee748bfa6d" status: 404 len: 109 microversion: 2.1 time: 0.090234 Aug 24 04:49:04.735995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 16/34] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:49:04 2022] GET /compute/v2.1/os-volumes/1c024b3d-23de-443b-9f73-57ee748bfa6d => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:49:05.059189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:05.059821 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:05.073560 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:05.075920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:05.078178 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:05.080933 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:05.086711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:05.088140 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:05.444889 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:05.455304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a5a4eb86-7622-485b-a902-2fac57f83013 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1279 microversion: 2.1 time: 0.399966 Aug 24 04:49:05.456115 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 19/35] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:05 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1279 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:06.477691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:06.478536 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:06.497193 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:06.498128 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:06.503464 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:06.504363 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:06.509209 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:06.512051 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:07.313859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:07.368287 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-279d75b0-57e7-4643-b08b-97afaf121acf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1279 microversion: 2.1 time: 0.895330 Aug 24 04:49:07.377189 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 17/36] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:06 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1279 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:08.576497 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:09.111448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6caac5db-5374-484b-a49b-cc6b4295b921 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'create', calling method: .version_select at 0x7fb05266a820>, body: {"keypair": {"name": "tempest-keypair-1268150505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvw+06weR21Qil+nNen3O3pWUqAuKk+WjI5QTyuWuebnaYFxWo17q9dyW56qK7NdQFZWsndfWaPVRjzosX09NAY7BO8kzq4tW9RWCLoKJ9Ig3ysrukp8MPT6B7M4z4wYg=="}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:09.179609 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1140948442", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "networks": [{"uuid": "ead85b25-e845-4125-ac0e-26cd19c9d8ac"}]}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:09.352956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=4 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:09.428267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-6caac5db-5374-484b-a49b-cc6b4295b921 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Getting quotas for project d2d97457b5cc4100a1ca1685f4c371e5. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:49:09.467120 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] validate_networks() for [('ead85b25-e845-4125-ac0e-26cd19c9d8ac', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:49:09.529404 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-6caac5db-5374-484b-a49b-cc6b4295b921 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Getting quotas for user 42ad8df34f8e405792afe94b91382122 and project d2d97457b5cc4100a1ca1685f4c371e5. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:49:09.807516 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6caac5db-5374-484b-a49b-cc6b4295b921 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.887104 Aug 24 04:49:09.810263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 20/37] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:49:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:49:09.826504 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:09.827306 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:09.846110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:09.848392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:09.850934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:09.852552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:09.853666 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:09.855188 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:10.528662 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:10.548891 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-28fff96e-52a8-49ee-9559-0413b688799f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1279 microversion: 2.1 time: 0.731502 Aug 24 04:49:10.553002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 21/38] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:09 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1279 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:11.579840 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:11.581550 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:11.598253 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:11.599201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:11.601214 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:11.603853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:11.616442 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:11.619003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:14.121532 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=18 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:14.341019 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:49:14.343621 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:49:14.349898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:49:14.350840 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:49:14.352599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:49:14.417562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:14.418089 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:14.427159 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:14.430910 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:14.445494 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:14.447954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:14.588356 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Getting quotas for project c16727c8f4db480f8fb07f96ecaa5eb6. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:49:14.631199 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Getting quotas for user 3fa3eb81fef84f7b8302af9ff733bbfe and project c16727c8f4db480f8fb07f96ecaa5eb6. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:49:14.704534 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:49:14.733227 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:49:14.952536 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a9d52602-c307-4e18-8d92-c31c7cd193ea tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.578768 Aug 24 04:49:14.959276 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 18/39] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 6586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:49:15.305566 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:15.357956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5371bd27-5ac6-456b-893d-2d8707218d0a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 3.783888 Aug 24 04:49:15.361853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 22/40] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:11 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 3789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:15.825462 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-afc824fc-d210-4609-897e-05f4dd543cce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: .version_select at 0x7fb050d94d30>, body: {"keypair": {"name": "tempest-keypair-1254139989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvS+mjS7rvVUNzbCgnC4Gqpwb8Dqvg13nbUBQwFuhr7sUQIqDBbXo2CbrJ2jCK8LB8NzlUSOu78pEkFi/6LQWliEBLA5/CsNH82RgojlOL5PifSfUPS3SLPWLTd54R33g=="}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:15.864899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=10 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:15.919264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-afc824fc-d210-4609-897e-05f4dd543cce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:49:15.937668 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-afc824fc-d210-4609-897e-05f4dd543cce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for user b847f94abee2439fab2f85f48abd7707 and project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:49:16.040368 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-afc824fc-d210-4609-897e-05f4dd543cce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.079417 Aug 24 04:49:16.048920 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 19/41] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:49:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:16.090610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7b71780b-1511-4a6f-b694-34040fe2e090 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:16.094996 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7b71780b-1511-4a6f-b694-34040fe2e090 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:16.404832 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-d8a00b9c-8563-49bc-9ffb-806de95fcfca req-b7f18983-9865-427c-9913-1cc969863bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c55e66d8-d307-4552-af1b-dd59c2b6f94f", "tag": "2cf3796f-8aa3-4a02-b84d-95b478e35e10"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:16.468696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-d8a00b9c-8563-49bc-9ffb-806de95fcfca req-b7f18983-9865-427c-9913-1cc969863bd1 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:16.471661 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-d8a00b9c-8563-49bc-9ffb-806de95fcfca req-b7f18983-9865-427c-9913-1cc969863bd1 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:16.473607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-d8a00b9c-8563-49bc-9ffb-806de95fcfca req-b7f18983-9865-427c-9913-1cc969863bd1 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:16.597487 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-d8a00b9c-8563-49bc-9ffb-806de95fcfca req-b7f18983-9865-427c-9913-1cc969863bd1 service nova] Creating event network-changed:2cf3796f-8aa3-4a02-b84d-95b478e35e10 for instance c55e66d8-d307-4552-af1b-dd59c2b6f94f on hv-cinder-85426 Aug 24 04:49:16.600285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-d8a00b9c-8563-49bc-9ffb-806de95fcfca req-b7f18983-9865-427c-9913-1cc969863bd1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127415) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 04:49:16.602784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-d8a00b9c-8563-49bc-9ffb-806de95fcfca req-b7f18983-9865-427c-9913-1cc969863bd1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127415) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 04:49:16.608345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-70f7bb2b-f3e6-4027-a447-851aaa3ddca5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:16.612701 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-70f7bb2b-f3e6-4027-a447-851aaa3ddca5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:16.613451 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-70f7bb2b-f3e6-4027-a447-851aaa3ddca5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:16.630332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-70f7bb2b-f3e6-4027-a447-851aaa3ddca5 None None] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:16.631354 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-70f7bb2b-f3e6-4027-a447-851aaa3ddca5 None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:16.632830 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-70f7bb2b-f3e6-4027-a447-851aaa3ddca5 None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:16.680911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.compute.rpcapi [None req-70f7bb2b-f3e6-4027-a447-851aaa3ddca5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 04:49:16.692701 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-70f7bb2b-f3e6-4027-a447-851aaa3ddca5 None None] Releasing lock "compute-rpcapi-router" {{(pid=127415) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 04:49:16.752897 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-70f7bb2b-f3e6-4027-a447-851aaa3ddca5 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.388389 Aug 24 04:49:16.753863 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 23/42] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:17.010433 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7b71780b-1511-4a6f-b694-34040fe2e090 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:17.034161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7b71780b-1511-4a6f-b694-34040fe2e090 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1215 microversion: 2.1 time: 0.982633 Aug 24 04:49:17.040898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 20/43] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:16 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1215 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:17.052052 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:17.069901 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:17.089485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:17.095601 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:17.096439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:17.111124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:17.115484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:17.120233 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:17.519480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-d84fb86a-115f-4e5d-9237-4846186028ed req-a591e353-204e-4209-9805-d4d48a3c9f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f7e127-b04d-4dd0-ac98-8c566e17d6e1", "tag": "0c800baa-57cc-40c6-bf82-bdd699f1f9d4"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:17.561108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-d84fb86a-115f-4e5d-9237-4846186028ed req-a591e353-204e-4209-9805-d4d48a3c9f5e service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:17.564533 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-d84fb86a-115f-4e5d-9237-4846186028ed req-a591e353-204e-4209-9805-d4d48a3c9f5e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:17.565304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-d84fb86a-115f-4e5d-9237-4846186028ed req-a591e353-204e-4209-9805-d4d48a3c9f5e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:17.604675 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-d84fb86a-115f-4e5d-9237-4846186028ed req-a591e353-204e-4209-9805-d4d48a3c9f5e service nova] Creating event network-changed:0c800baa-57cc-40c6-bf82-bdd699f1f9d4 for instance 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 on hv-cinder-85426 Aug 24 04:49:17.616463 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-d84fb86a-115f-4e5d-9237-4846186028ed req-a591e353-204e-4209-9805-d4d48a3c9f5e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.860568 Aug 24 04:49:17.617353 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 24/44] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:18.084785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:18.095695 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:18.118588 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:18.124817 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:18.132023 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:18.134097 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:18.135486 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:18.139187 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:19.396552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:19.415501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0fe12f9e-8bad-411f-b96a-8b00bae1cd82 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1275 microversion: 2.1 time: 1.341410 Aug 24 04:49:19.419829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 25/45] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:18 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1275 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:19.713735 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:19.744438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-cd517026-2e7b-48b3-bb72-268fcaabda82 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 2.701732 Aug 24 04:49:19.750097 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 21/46] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:17 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 2708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:20.447016 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:20.447838 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:20.451071 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=4 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:20.480981 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:20.481400 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:20.481861 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:20.482634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:20.494853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:20.495382 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:20.782334 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:20.783394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:20.800398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:20.800910 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:20.801358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:20.814752 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:20.815632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:20.816539 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:21.332639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:21.360643 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b96e940a-1bde-4de9-bcd4-346e9f81c87d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1273 microversion: 2.1 time: 0.917866 Aug 24 04:49:21.364592 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 26/47] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:20 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1273 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:21.523458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1741816909", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "821e5cbb-91e0-4e54-aa76-326181a39890"}], "security_groups": [{"name": "tempest-securitygroup--1885841118"}], "key_name": "tempest-keypair-1969204994", "user_data": "}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:21.616525 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:21.650117 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7a0ae76c-0b61-45ae-83a2-c7ac3bc2aa0d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.872661 Aug 24 04:49:21.651498 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 22/48] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:20 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:21.670805 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:22.199869 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.network.neutron [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] validate_networks() for [('821e5cbb-91e0-4e54-aa76-326181a39890', None, None, None, None, None)] {{(pid=127415) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:49:22.392523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:22.393226 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:22.413472 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:22.414188 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:22.414834 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:22.416692 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:22.422957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:22.424017 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:22.727617 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:22.765894 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c7d9262c-a992-4960-8424-914283d1de54 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1273 microversion: 2.1 time: 0.381335 Aug 24 04:49:22.782162 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 23/49] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:22 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1273 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:22.791002 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:22.808266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:22.841968 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:22.843052 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:22.846414 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:22.848175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:22.854079 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:22.855339 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:23.831763 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:23.850889 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-919922d1-7cc9-4ad1-8c13-f50cb5e3c083 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 1.066903 Aug 24 04:49:23.853882 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 24/50] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:22 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:23.881756 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:23.884900 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:23.915488 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:23.916625 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:23.917295 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:23.918586 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:23.919610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:23.920216 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:24.481780 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:25.105929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:25.143564 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-deb31249-4817-4c8a-aca6-e7f2dcd0c98f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 1.279776 Aug 24 04:49:25.145566 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 25/51] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:23 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:25.182432 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:25.186281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:25.218085 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Flavor limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:49:25.219492 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:25.220128 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Image limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:49:25.221109 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:25.221258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Flavor pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:49:25.221958 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:25.222302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Image pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:49:25.223217 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:49:25.223433 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:25.224266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:25.224996 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:25.248802 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:25.250400 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:25.251457 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:25.252967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:25.253920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:25.254897 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:25.306791 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Getting quotas for project 02571d09157b409a8bd4737acd07c5de. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:49:25.315720 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Getting quotas for user 7c5112136c7947e3ac99949d330ba0be and project 02571d09157b409a8bd4737acd07c5de. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:49:25.342257 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Going to run 1 instances... {{(pid=127415) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:49:25.346802 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:49:25.485002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9ad49399-626e-43ef-8ff5-d40def1088f0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.967067 Aug 24 04:49:25.486244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 27/52] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Aug 24 04:49:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 3970 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 04:49:25.529790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-54c2815f-78c2-4eac-9aee-bb187bf5330e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:25.531041 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-54c2815f-78c2-4eac-9aee-bb187bf5330e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:25.855991 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-54c2815f-78c2-4eac-9aee-bb187bf5330e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:25.897901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-54c2815f-78c2-4eac-9aee-bb187bf5330e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:25.900861 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-54c2815f-78c2-4eac-9aee-bb187bf5330e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:25.903141 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-54c2815f-78c2-4eac-9aee-bb187bf5330e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1282 microversion: 2.20 time: 0.400888 Aug 24 04:49:25.919972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 28/53] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:25 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1282 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:49:25.957607 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:25.962637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=47 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:25.972499 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0cbd6075-f52d-45b0-a22c-3564d9422691 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.821529 Aug 24 04:49:25.974431 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 26/54] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:25 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:26.191314 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:26.193089 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:26.211153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:26.212128 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:26.213440 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:26.215744 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:26.216559 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:26.217357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:26.651939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:26.666562 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d5717402-6c74-4a50-ba93-5ef0158bf6cc tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.479513 Aug 24 04:49:26.667236 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 29/55] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:26 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:26.941524 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:26.947622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:26.971845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:26.972725 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:26.980002 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:26.981532 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:26.982819 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:26.984001 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:27.010910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:27.021190 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=12 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:27.021941 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:27.071898 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:27.075076 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:27.077831 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:27.083083 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:27.084174 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:27.088689 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:27.235559 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:27.258506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:27.274100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:27.275712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ef516ee6-17ec-423a-8384-899c0b7627a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1278 microversion: 2.20 time: 0.343805 Aug 24 04:49:27.279623 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 27/56] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:26 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1278 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:27.504149 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:27.514404 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4007bf08-df1c-49b1-bc63-ac0bb22d8395 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.511731 Aug 24 04:49:27.520108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 30/57] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:27 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:27.693575 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:27.694615 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:27.710888 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:27.713629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:27.718245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:27.721119 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:27.725064 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:27.729271 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:28.308547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:28.309763 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:28.323497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:28.323981 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:28.324425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:28.325138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:28.325593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:28.326050 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:28.384697 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:28.396004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-edd7e71f-da5d-429b-8166-c00dbad3469f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.710445 Aug 24 04:49:28.397961 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 28/58] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:27 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:28.496859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:28.521564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:28.525782 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:28.532204 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-832e701a-2b46-47dd-ae06-23498cfc9ad8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1340 microversion: 2.20 time: 0.228069 Aug 24 04:49:28.554563 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 31/59] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:28 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1340 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:28.556635 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:28.557595 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:28.575028 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:28.576015 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:28.576469 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:28.577210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:28.577693 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:28.578233 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:28.803700 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:28.816684 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7c250a48-e912-4ad2-90e0-8214a7f39d2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.263637 Aug 24 04:49:28.817622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 29/60] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:28 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:29.223631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-682094126", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f29fec8-6960-4724-afc6-f75ed363894e"}], "security_groups": [{"name": "tempest-securitygroup--699391589"}], "key_name": "tempest-keypair-1268150505", "user_data": "}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:29.419714 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.network.neutron [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] validate_networks() for [('5f29fec8-6960-4724-afc6-f75ed363894e', None, None, None, None, None)] {{(pid=127415) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:49:29.422581 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:29.424950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:29.447490 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:29.450407 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:29.450897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:29.451629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:29.455667 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:29.456421 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:29.816013 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:29.824394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4e9ceaac-e3be-4c04-a5ad-084cb9e2ffee tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.406475 Aug 24 04:49:29.834927 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 30/61] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:29 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:29.843355 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1690651876", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bc1ad55-5d65-47b3-8be9-9d83a75436be"}], "security_groups": [{"name": "tempest-securitygroup--1131635689"}], "key_name": "tempest-keypair-1254139989", "user_data": "}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:30.036579 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] validate_networks() for [('5bc1ad55-5d65-47b3-8be9-9d83a75436be', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:49:30.300361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Flavor limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:49:30.300881 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Image limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:49:30.301505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Flavor pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:49:30.302176 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Image pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:49:30.302913 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:49:30.327063 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:30.327990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:30.329596 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:30.331146 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:30.331992 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:30.332745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:30.367207 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Getting quotas for project d2d97457b5cc4100a1ca1685f4c371e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:49:30.376595 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Getting quotas for user 42ad8df34f8e405792afe94b91382122 and project d2d97457b5cc4100a1ca1685f4c371e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:49:30.412583 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Going to run 1 instances... {{(pid=127415) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:49:30.419343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:49:30.517335 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a2ef35fe-4986-46ca-9853-b62b8b611e54 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.300262 Aug 24 04:49:30.526898 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:49:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:49:30.533566 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-dac75a3f-d1fd-4721-9fd9-595b9ff645c0 req-f139d0ae-338a-4c04-b017-f710d7a52630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff3947d-3ca7-4419-81d2-7f729d51a491", "tag": "d224240c-4f12-434d-83c9-3c34c2acf103"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:30.545162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-dac75a3f-d1fd-4721-9fd9-595b9ff645c0 req-f139d0ae-338a-4c04-b017-f710d7a52630 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:30.546474 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-dac75a3f-d1fd-4721-9fd9-595b9ff645c0 req-f139d0ae-338a-4c04-b017-f710d7a52630 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:30.550470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-dac75a3f-d1fd-4721-9fd9-595b9ff645c0 req-f139d0ae-338a-4c04-b017-f710d7a52630 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:30.588140 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-dac75a3f-d1fd-4721-9fd9-595b9ff645c0 req-f139d0ae-338a-4c04-b017-f710d7a52630 service nova] Creating event network-changed:d224240c-4f12-434d-83c9-3c34c2acf103 for instance dff3947d-3ca7-4419-81d2-7f729d51a491 on hv-cinder-85426 Aug 24 04:49:30.597781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-dac75a3f-d1fd-4721-9fd9-595b9ff645c0 req-f139d0ae-338a-4c04-b017-f710d7a52630 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069309 Aug 24 04:49:30.602307 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 33/63] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:30.620901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:30.621945 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:30.631227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:30.631761 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:30.632379 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:30.633588 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:30.634480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:30.635068 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:30.771036 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:30.789451 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:30.791428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:30.792785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-095d7b2c-2185-4519-a1b0-e76b26fdbc09 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1340 microversion: 2.20 time: 0.189216 Aug 24 04:49:30.798149 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 34/64] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:30 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1340 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:30.803657 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:30.804667 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:30.826351 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:49:30.827674 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:49:30.829116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:49:30.829702 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:49:30.830294 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:49:30.845206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:30.845746 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:30.846253 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:30.846987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:30.847622 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:30.848055 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:30.857496 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:30.861120 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:30.864765 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:30.865724 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:30.866365 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:30.866896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:30.910193 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:49:30.917954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for user b847f94abee2439fab2f85f48abd7707 and project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:49:30.933690 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:49:30.936440 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:49:31.013982 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-6528ea06-d683-4f0f-97f7-0637f867a647 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.177191 Aug 24 04:49:31.015075 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 31/65] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:49:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:49:31.023326 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bde695fb-90b6-4b3b-b1b4-3bcfaece5c7d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:31.024319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bde695fb-90b6-4b3b-b1b4-3bcfaece5c7d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:31.141328 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bde695fb-90b6-4b3b-b1b4-3bcfaece5c7d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:31.155269 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bde695fb-90b6-4b3b-b1b4-3bcfaece5c7d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1237 microversion: 2.1 time: 0.137622 Aug 24 04:49:31.156997 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 32/66] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:31 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1237 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:31.163704 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:31.165352 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:31.176421 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:31.177200 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:31.177647 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:31.180581 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:31.183903 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:31.185758 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:31.188304 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:31.188432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-dbf2fd6d-d32c-4059-b64c-c115c45cad70 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.388781 Aug 24 04:49:31.202618 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 35/67] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:30 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:31.208643 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-fe91bcfc-aceb-4fdf-8ca3-a05a555d9a12 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:31.209271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-fe91bcfc-aceb-4fdf-8ca3-a05a555d9a12 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:31.332396 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-fe91bcfc-aceb-4fdf-8ca3-a05a555d9a12 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:31.342164 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-fe91bcfc-aceb-4fdf-8ca3-a05a555d9a12 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1242 microversion: 2.1 time: 0.137579 Aug 24 04:49:31.345680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 36/68] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:31 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:31.513383 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:31.527381 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a6bd940c-2f42-4b48-9396-28244d02fe6a tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.368703 Aug 24 04:49:31.532148 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 33/69] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:31 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:31.822250 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:31.823828 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:31.837534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:31.838593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:31.840746 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:31.844374 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:31.845092 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:31.846613 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:31.862807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=85 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:32.025324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:32.041839 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:32.052456 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:32.053803 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-33f1183f-0235-4ab2-a341-c863d06f04be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1340 microversion: 2.20 time: 0.237452 Aug 24 04:49:32.054525 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 37/70] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:31 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1340 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:32.182280 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:32.184630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:32.210047 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:32.210374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:32.211072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:32.211846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:32.213595 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:32.215953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:32.218224 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:32.222255 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:32.226835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:32.231112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:32.232676 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:32.238073 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:32.239642 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:32.241747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:32.638056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:32.654198 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8102b7ce-7062-4f90-a326-104308609a67 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1297 microversion: 2.1 time: 0.475933 Aug 24 04:49:32.655522 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 34/71] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:32 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1297 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:32.814838 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:32.825264 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3f9c7c94-6d1c-4890-ad84-a449763c8819 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.619472 Aug 24 04:49:32.829951 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-baead0e6-e28f-4084-a687-0f7482375e5f req-2fc39b99-9e1a-46c6-b8f3-aedfdfa6cab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f7e127-b04d-4dd0-ac98-8c566e17d6e1", "name": "network-vif-plugged", "status": "completed", "tag": "0c800baa-57cc-40c6-bf82-bdd699f1f9d4"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:32.842917 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 38/72] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:32 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:32.850970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:32.851951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:32.860065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-baead0e6-e28f-4084-a687-0f7482375e5f req-2fc39b99-9e1a-46c6-b8f3-aedfdfa6cab0 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:32.860300 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:32.860666 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:32.861017 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-baead0e6-e28f-4084-a687-0f7482375e5f req-2fc39b99-9e1a-46c6-b8f3-aedfdfa6cab0 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:32.861144 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:32.861535 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-baead0e6-e28f-4084-a687-0f7482375e5f req-2fc39b99-9e1a-46c6-b8f3-aedfdfa6cab0 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:32.861790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:32.864539 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:32.865020 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:32.900704 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-baead0e6-e28f-4084-a687-0f7482375e5f req-2fc39b99-9e1a-46c6-b8f3-aedfdfa6cab0 service nova] Creating event network-vif-plugged:0c800baa-57cc-40c6-bf82-bdd699f1f9d4 for instance 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 on hv-cinder-85426 Aug 24 04:49:32.901259 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-baead0e6-e28f-4084-a687-0f7482375e5f req-2fc39b99-9e1a-46c6-b8f3-aedfdfa6cab0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127416) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 04:49:32.902125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-baead0e6-e28f-4084-a687-0f7482375e5f req-2fc39b99-9e1a-46c6-b8f3-aedfdfa6cab0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127416) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 04:49:32.903414 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bb780f9-604b-4f4c-9c9e-685390ae7e88 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:32.904126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bb780f9-604b-4f4c-9c9e-685390ae7e88 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:32.905035 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bb780f9-604b-4f4c-9c9e-685390ae7e88 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:32.907792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bb780f9-604b-4f4c-9c9e-685390ae7e88 None None] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:32.909265 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bb780f9-604b-4f4c-9c9e-685390ae7e88 None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:32.910266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bb780f9-604b-4f4c-9c9e-685390ae7e88 None None] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:32.943418 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.compute.rpcapi [None req-4bb780f9-604b-4f4c-9c9e-685390ae7e88 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 04:49:32.944493 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bb780f9-604b-4f4c-9c9e-685390ae7e88 None None] Releasing lock "compute-rpcapi-router" {{(pid=127416) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 04:49:33.002325 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4bb780f9-604b-4f4c-9c9e-685390ae7e88 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343245 Aug 24 04:49:33.003537 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 35/73] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:33.012702 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:33.014607 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:33.037839 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.040628 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.041444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.043562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.047413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.048278 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.078338 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:33.097139 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3f1b4b79-609b-4e7f-9887-63147a258a51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1294 microversion: 2.1 time: 0.251740 Aug 24 04:49:33.097749 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 39/74] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:32 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1294 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:33.117073 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:33.117688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:33.138944 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.139434 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.149449 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.154286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.154794 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.156779 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.400385 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:33.415380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:33.417625 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:33.419032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d3707b9d-6f5b-4241-96a8-bc0748bab143 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1340 microversion: 2.20 time: 0.315780 Aug 24 04:49:33.421277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 40/75] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:33 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1340 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:33.479003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:33.497015 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-748b334d-1bb4-4f02-bb37-b65d6133beae tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.491693 Aug 24 04:49:33.497803 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 36/76] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:33 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:33.677923 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:33.678659 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:33.689508 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.690443 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.696516 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.698117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.698682 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.701582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.849284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:33.849895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:33.867421 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:33.885976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4f13ea94-c2c2-4906-9908-bd84ab94e2ab tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1295 microversion: 2.1 time: 0.212470 Aug 24 04:49:33.894894 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.895419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.895988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.896732 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.897184 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.897605 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.902601 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 41/77] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:33 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1295 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:34.127281 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:34.128137 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:34.146580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:34.148740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:34.149392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:34.150567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:34.155610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:34.156819 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:34.384316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:34.394336 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6b15bcc7-d1e6-4757-9ad8-5a1acc0c969e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1300 microversion: 2.1 time: 0.271479 Aug 24 04:49:34.399564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 42/78] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:34 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1300 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:34.448325 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:34.452541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:34.455174 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:34.464952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-39e58f34-f834-4d5f-ad7e-34cf3b18caf4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.619335 Aug 24 04:49:34.467565 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 37/79] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:33 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:34.467733 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:34.468776 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:34.475507 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:34.476774 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:34.477509 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:34.478260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:34.523144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:34.523780 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:34.537655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:34.538545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:34.539198 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:34.540272 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:34.541310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:34.541958 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:34.895309 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:34.903000 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:34.912903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:34.914281 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:34.916017 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e5187e2b-b717-4e8b-9bc8-7c095c713405 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.472079 Aug 24 04:49:34.924933 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-be61a0e3-7579-4f67-bab4-d5ab41c44837 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.401722 Aug 24 04:49:34.929077 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 38/80] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:34 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:34.930394 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 43/81] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:34 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:34.939065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:34.939712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:34.949802 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:34.950327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:34.950815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:34.951821 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:34.951946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:34.952290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:35.023792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-35da3a3e-35c4-4607-8d8c-40ff5dd8d981 req-38e92f0c-0912-4afd-baf8-46643b55f3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c55e66d8-d307-4552-af1b-dd59c2b6f94f", "name": "network-vif-plugged", "status": "completed", "tag": "2cf3796f-8aa3-4a02-b84d-95b478e35e10"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:35.035232 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-35da3a3e-35c4-4607-8d8c-40ff5dd8d981 req-38e92f0c-0912-4afd-baf8-46643b55f3c2 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:35.036064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-35da3a3e-35c4-4607-8d8c-40ff5dd8d981 req-38e92f0c-0912-4afd-baf8-46643b55f3c2 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:35.036685 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-35da3a3e-35c4-4607-8d8c-40ff5dd8d981 req-38e92f0c-0912-4afd-baf8-46643b55f3c2 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:35.049602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-35da3a3e-35c4-4607-8d8c-40ff5dd8d981 req-38e92f0c-0912-4afd-baf8-46643b55f3c2 service nova] Creating event network-vif-plugged:2cf3796f-8aa3-4a02-b84d-95b478e35e10 for instance c55e66d8-d307-4552-af1b-dd59c2b6f94f on hv-cinder-85426 Aug 24 04:49:35.057948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-35da3a3e-35c4-4607-8d8c-40ff5dd8d981 req-38e92f0c-0912-4afd-baf8-46643b55f3c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037700 Aug 24 04:49:35.061098 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 44/82] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:49:35.385290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:35.400899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-25de9428-4a4b-4744-9a70-595ef8c1d695 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.468920 Aug 24 04:49:35.403637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 39/83] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:34 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:35.423756 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:35.424905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:35.451209 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:35.451922 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:35.452746 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:35.454318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:35.455606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:35.456559 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:35.487297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:35.488213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:35.503895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:35.504374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:35.504809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:35.508397 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:35.510770 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:35.511670 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:35.709197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:35.725854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-02171d48-fd9f-4d3b-adcf-f59881ff61e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1300 microversion: 2.1 time: 0.306824 Aug 24 04:49:35.726457 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 45/84] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:35 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1300 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:35.837765 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:35.847262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-47ad77f5-0f94-487e-944b-5acbd25598a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.364278 Aug 24 04:49:35.861926 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 40/85] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:35 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:35.956929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:35.957896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:35.963937 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:35.965128 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:35.995813 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:35.996585 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:35.997412 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:35.998358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:35.999025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.000691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.001759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.003976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.006473 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.007722 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.008959 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.010434 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.234877 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:36.245615 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d1f24273-c027-4644-aeb7-7903c3072aed tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.299093 Aug 24 04:49:36.255195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 41/86] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:35 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:36.260158 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-89750973-8b9d-4d1a-98de-b54fcad235ba req-a5b23f59-c2c2-4cae-bfcb-f150d3cf7984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02869b36-2e27-488f-9e94-c82e7094038d", "tag": "1c0068ae-b002-49bf-bdba-6a7c76bf094f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:36.273709 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-89750973-8b9d-4d1a-98de-b54fcad235ba req-a5b23f59-c2c2-4cae-bfcb-f150d3cf7984 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.274306 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-89750973-8b9d-4d1a-98de-b54fcad235ba req-a5b23f59-c2c2-4cae-bfcb-f150d3cf7984 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.274743 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-89750973-8b9d-4d1a-98de-b54fcad235ba req-a5b23f59-c2c2-4cae-bfcb-f150d3cf7984 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.283762 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:36.290537 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-89750973-8b9d-4d1a-98de-b54fcad235ba req-a5b23f59-c2c2-4cae-bfcb-f150d3cf7984 service nova] Creating event network-changed:1c0068ae-b002-49bf-bdba-6a7c76bf094f for instance 02869b36-2e27-488f-9e94-c82e7094038d on hv-cinder-85426 Aug 24 04:49:36.293081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:36.294671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:36.295825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0ed6e871-3b6c-47a9-ba79-a229c24110cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.356128 Aug 24 04:49:36.302816 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 46/87] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:35 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:36.305990 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-89750973-8b9d-4d1a-98de-b54fcad235ba req-a5b23f59-c2c2-4cae-bfcb-f150d3cf7984 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049232 Aug 24 04:49:36.306944 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 42/88] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:36.310790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-e531597a-d076-408d-9253-41856b703776 req-ac66a701-eb0b-4169-a918-28daaab13fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eeaea49-9c15-4e0a-a446-98d3191293c8", "tag": "6bd895e9-3f00-4d89-aab3-7b4bbc97e62d"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:36.322608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-e531597a-d076-408d-9253-41856b703776 req-ac66a701-eb0b-4169-a918-28daaab13fd5 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.323093 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-e531597a-d076-408d-9253-41856b703776 req-ac66a701-eb0b-4169-a918-28daaab13fd5 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.323529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-e531597a-d076-408d-9253-41856b703776 req-ac66a701-eb0b-4169-a918-28daaab13fd5 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.338450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-e531597a-d076-408d-9253-41856b703776 req-ac66a701-eb0b-4169-a918-28daaab13fd5 service nova] Creating event network-changed:6bd895e9-3f00-4d89-aab3-7b4bbc97e62d for instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 on hv-cinder-85426 Aug 24 04:49:36.344983 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-e531597a-d076-408d-9253-41856b703776 req-ac66a701-eb0b-4169-a918-28daaab13fd5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046148 Aug 24 04:49:36.345917 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 47/89] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:36.430280 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:36.431316 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:36.442754 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.443570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.444302 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.445483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.446666 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.447461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.658121 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:36.666457 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-826a4938-72c1-4a11-9205-2420c51eeab0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.245189 Aug 24 04:49:36.667100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 43/90] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:36 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:36.752210 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:36.753013 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:36.759298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.759954 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.760388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.761166 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.761837 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.762196 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.869926 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:36.871273 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:36.878191 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.878685 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.879281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.880249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:36.880947 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:36.881439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:36.923800 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:36.946755 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-206dbce3-e37c-49bc-98c4-081d7f36521f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.199314 Aug 24 04:49:36.960934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 48/91] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:36 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:37.038311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:37.046090 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-aa994a7a-da53-4366-bf5f-507fc73d9f4a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.180951 Aug 24 04:49:37.047379 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 44/92] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:36 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:37.276269 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:37.277225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:37.284247 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:37.284822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:37.285321 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:37.286121 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:37.286631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:37.287158 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:37.319962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:37.320828 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:37.328134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:37.329042 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:37.329689 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:37.330634 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:37.331279 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:37.331883 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:37.489373 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:37.497907 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c7e8d9cf-d9e1-4f58-a7e7-edf0fd0ab603 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.225663 Aug 24 04:49:37.498575 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 49/93] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:37 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:37.519590 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:37.529953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:37.531591 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:37.532484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-71545786-b70d-4de1-91c8-ee543717deaa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.216423 Aug 24 04:49:37.535507 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 45/94] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:37 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:49:37.690276 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:37.690882 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:37.697152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:37.697632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:37.698161 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:37.698848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:37.699296 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:37.699716 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:37.843120 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:37.856331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-52b76da6-b1a3-42be-a7ac-298f69797010 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.168970 Aug 24 04:49:37.856947 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 50/95] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:37 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:37.967662 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:37.968436 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:37.974823 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:37.975293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:37.975725 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:37.976429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:37.976872 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:37.977457 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:37.995523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=100 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:38.075166 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:38.076203 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:38.085580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:38.086349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:38.087000 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:38.087914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:38.088552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:38.089169 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:38.131439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:38.139822 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-15da479c-d790-4358-aee9-656f6708dc8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.175782 Aug 24 04:49:38.141296 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 46/96] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:37 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:38.240188 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:38.248349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ec8dd6e3-cc83-4b0a-b690-1d8ffeb3dd61 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.180082 Aug 24 04:49:38.248926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 51/97] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:38 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:38.522817 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:38.523852 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:38.534878 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:38.535505 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:38.536217 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:38.537506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:38.538471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:38.539324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:38.557635 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:38.558368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:38.589042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:38.589568 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:38.589994 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:38.590737 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:38.591190 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:38.591613 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:38.876725 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:38.890957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-73b7f1a7-2fe3-4fca-9101-4982e2ba9e62 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.374324 Aug 24 04:49:38.891798 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 47/98] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:38 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:38.902315 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:38.903792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:38.913514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:38.919478 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:38.922309 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:38.923469 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:38.924657 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:38.925649 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:38.927176 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:38.937366 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:38.939310 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:38.941004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-534f3637-7bc3-4bc6-9847-b58fcea16a6b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.387815 Aug 24 04:49:38.941782 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 52/99] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:38 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:49:39.144868 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:39.153878 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d3f8ed74-da6f-4f34-b439-fb93446d23a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.260680 Aug 24 04:49:39.154655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 48/100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:38 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:39.175313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:39.175977 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:39.189436 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:39.190136 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:39.190892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:39.191848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:39.192325 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:39.192745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:39.268846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:39.269624 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:39.278312 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:39.278808 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:39.283754 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:39.284569 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:39.285048 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:39.285482 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:39.511081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:39.520697 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-12546833-b9ab-4f78-b666-3634eeb950c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.354900 Aug 24 04:49:39.532512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:39.532902 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 53/101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:39 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:39.539922 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4a175e62-2999-4bd7-b8d2-054936cbe1be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1321 microversion: 2.1 time: 0.273248 Aug 24 04:49:39.543198 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 49/102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:39 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:39.648036 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-095eb6b4-9260-4ab0-a426-3a4e2bfe965f req-8a987cd0-187b-4c70-a20e-89be3181eb1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79fe8ef-51d0-4ca2-9e41-940ee142b819", "tag": "4c78e02d-9548-429c-8228-3b6cbd0d044c"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:39.664248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-095eb6b4-9260-4ab0-a426-3a4e2bfe965f req-8a987cd0-187b-4c70-a20e-89be3181eb1e service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:39.665165 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-095eb6b4-9260-4ab0-a426-3a4e2bfe965f req-8a987cd0-187b-4c70-a20e-89be3181eb1e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:39.666052 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-095eb6b4-9260-4ab0-a426-3a4e2bfe965f req-8a987cd0-187b-4c70-a20e-89be3181eb1e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:39.681170 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-095eb6b4-9260-4ab0-a426-3a4e2bfe965f req-8a987cd0-187b-4c70-a20e-89be3181eb1e service nova] Creating event network-changed:4c78e02d-9548-429c-8228-3b6cbd0d044c for instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 on hv-cinder-85426 Aug 24 04:49:39.695784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-095eb6b4-9260-4ab0-a426-3a4e2bfe965f req-8a987cd0-187b-4c70-a20e-89be3181eb1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048704 Aug 24 04:49:39.698150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 54/103] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:39.913644 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:39.914366 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:39.924790 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:39.929482 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:39.930152 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:39.933005 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:39.934550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:39.937459 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:39.969776 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:39.970671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:39.986680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:39.987225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:39.992467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:39.993606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:39.994095 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:39.994521 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:40.217790 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:40.230063 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-72517e1d-82ea-4170-9444-6858597ae217 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.321071 Aug 24 04:49:40.232808 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 50/104] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:39 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:40.248311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:40.249183 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:40.260310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:40.260755 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:40.261322 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:40.262413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:40.262954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:40.264244 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:40.269307 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:40.271853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:40.299631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:40.302364 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:40.304502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c5e80068-e608-4bc3-9adc-c2d555e3b3fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.344531 Aug 24 04:49:40.306132 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 55/105] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:39 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:40.498470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:40.508111 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9d0865e2-7e56-40e1-b5f5-a2ea3322c0ac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.274059 Aug 24 04:49:40.509307 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 51/106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:40 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:40.551024 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:40.552263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:40.554851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=6 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:40.569751 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:40.572831 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:40.573876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:40.576226 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:40.578704 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:40.581329 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:40.581978 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:40.584724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:40.590646 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:40.594846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:40.595576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:40.596596 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:40.597234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:40.598815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:40.876935 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:40.881239 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:40.886748 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ac5ff987-1fb6-48b8-a167-dcb84c3c7dc0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1516 microversion: 2.1 time: 0.326030 Aug 24 04:49:40.895957 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8e118121-d808-4c4a-a81c-0700dae327e0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.351678 Aug 24 04:49:40.898191 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 56/107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:40 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:40.902708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 52/108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:40 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1516 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:40.924314 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:40.928230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:40.935955 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:40.936584 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:40.937990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:40.939692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:40.940396 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:40.940639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:41.035237 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lazy-loading 'flavor' on Instance uuid 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:49:41.176432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d0d690ac-9018-44f8-9337-50018090e3cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1/action" status: 200 len: 32 microversion: 2.1 time: 0.259026 Aug 24 04:49:41.177290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 57/109] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:49:40 2022] POST /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:49:41.188236 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:41.188975 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:41.191014 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=8 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:41.197641 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:41.198538 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:41.199138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:41.199846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:41.200496 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:41.200997 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:41.258927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:41.260026 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:41.267123 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:41.267715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:41.268226 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:41.269003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:41.269533 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:41.270041 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:41.345693 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=16 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:41.543998 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:41.555795 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2cb056cc-9281-4978-badb-4a4310fb4905 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.372233 Aug 24 04:49:41.557239 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 53/110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:41 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:41.575321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:41.578662 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:41.591874 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:41.595494 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:41.597121 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:41.598855 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:41.600943 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:41.603274 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:41.603982 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:41.664313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:41.679055 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e2a3a6ee-1253-4570-a1e8-b3b8d5d3a110 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.425599 Aug 24 04:49:41.681159 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 58/111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:41 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:41.690861 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:41.691186 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:41.693339 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:41.705525 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:41.706649 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:41.707635 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:41.709422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:41.709964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:41.710829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:41.988549 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:41.998783 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:42.001016 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:42.002184 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-13e61d8a-2343-4166-a57f-a1b2b72c5a4b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.442923 Aug 24 04:49:42.002755 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 54/112] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:41 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:42.008743 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-10e04387-967d-49fb-9056-00b2bb1d62e9 req-229cc4e4-fcbc-4648-be88-2bfb52a2cd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff3947d-3ca7-4419-81d2-7f729d51a491", "name": "network-vif-plugged", "status": "completed", "tag": "d224240c-4f12-434d-83c9-3c34c2acf103"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:42.022210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-10e04387-967d-49fb-9056-00b2bb1d62e9 req-229cc4e4-fcbc-4648-be88-2bfb52a2cd13 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:42.022691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-10e04387-967d-49fb-9056-00b2bb1d62e9 req-229cc4e4-fcbc-4648-be88-2bfb52a2cd13 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:42.023112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-10e04387-967d-49fb-9056-00b2bb1d62e9 req-229cc4e4-fcbc-4648-be88-2bfb52a2cd13 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:42.036064 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-10e04387-967d-49fb-9056-00b2bb1d62e9 req-229cc4e4-fcbc-4648-be88-2bfb52a2cd13 service nova] Creating event network-vif-plugged:d224240c-4f12-434d-83c9-3c34c2acf103 for instance dff3947d-3ca7-4419-81d2-7f729d51a491 on hv-cinder-85426 Aug 24 04:49:42.047578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-10e04387-967d-49fb-9056-00b2bb1d62e9 req-229cc4e4-fcbc-4648-be88-2bfb52a2cd13 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041882 Aug 24 04:49:42.049015 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 55/113] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:42.058292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:42.064097 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:42.072454 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:42.073020 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:42.079504 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:42.082811 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:42.086504 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:42.088140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:42.162135 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:42.183519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-126d1af9-e962-42b1-8add-9d546421eb57 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.499937 Aug 24 04:49:42.202960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 59/114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:41 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:42.581267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:42.582420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:42.590929 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:42.596344 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:42.596880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:42.598050 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:42.598749 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:42.599402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:42.819166 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:42.833082 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-67483e92-b63e-4172-b2a0-f26c016104ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.781438 Aug 24 04:49:42.835755 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 56/115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:42 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:42.840697 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:42.841300 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:42.860133 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:42.860967 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:42.861383 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:42.862328 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:42.862832 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:42.863401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:42.921633 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:42.962267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:42.972355 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-69d84db2-b2ce-41fc-b19a-4dddf563eafc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.395399 Aug 24 04:49:42.972945 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 60/116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:42 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:43.033271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:43.033271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:43.042788 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:43.043513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:43.044358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:43.045252 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:43.046043 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:43.047811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:43.161042 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:43.169434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bf3ab642-b4c1-4c02-8786-57d5cc9c4063 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.332365 Aug 24 04:49:43.170379 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 57/117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:42 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:43.224534 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:43.225331 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:43.234848 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:43.235545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:43.236418 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:43.237854 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:43.238353 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:43.238778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:43.321897 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:43.338223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:43.338223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:43.339026 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-cd06fc02-4381-4218-895d-6cc58ce3821f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.313093 Aug 24 04:49:43.340259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 61/118] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:43 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:43.461393 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:43.470340 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2cbd2145-884a-4274-8b4d-23e5cf40cd06 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.249819 Aug 24 04:49:43.484052 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 58/119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:43 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:43.856867 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:43.857686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:43.868781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:43.869519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:43.870255 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:43.871137 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:43.871729 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:43.872535 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:43.995354 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:43.996587 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:44.007493 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:44.007979 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:44.008406 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:44.009241 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:44.009697 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:44.010193 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:44.097726 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:44.126431 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-bb7cbb69-98bc-46d4-a413-a46bbeb20457 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.273417 Aug 24 04:49:44.130025 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 62/120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:43 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:44.191662 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:44.191870 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:44.203932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:44.204524 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:44.211918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:44.212667 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:44.213151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:44.213627 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:44.371855 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:44.382786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7759b99b-1765-41cd-a477-64fcd5c047be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.391415 Aug 24 04:49:44.383383 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 59/121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:43 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:44.388425 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:44.389467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:44.398577 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:44.399308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:44.399885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:44.400965 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:44.403903 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:44.404740 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:44.680629 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:44.691705 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b9095f29-c5de-49fe-ac94-ea10fda967f8 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.505132 Aug 24 04:49:44.699730 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:44.706576 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 63/122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:44 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:44.712885 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:44.714724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:44.720667 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:44.723476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:44.724497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:44.724665 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:44.725366 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:44.726732 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:44.727096 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ee6f18ff-eca4-4607-84f9-6f5f1fa81d4a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.342317 Aug 24 04:49:44.727827 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:44.741417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:44.741637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 60/123] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:44 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:44.889430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:44.899114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e5bd1b16-eb24-425d-af43-7a349b7300d4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.190955 Aug 24 04:49:44.899951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 64/124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:44 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:45.148363 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:45.149052 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:45.156465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.156962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.157457 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:45.158460 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.158912 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.159806 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:45.319416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:45.335109 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7138d9cc-ff58-42c9-b9ca-6497c3997d8a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.190644 Aug 24 04:49:45.336664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 61/125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:45 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:45.408722 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:45.409541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:45.416467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.417143 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.417685 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:45.418526 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.419181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.419609 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:45.567522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:45.584244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-38d0fc93-93d5-42de-a3b5-3b7de515a259 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.180556 Aug 24 04:49:45.585210 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 65/126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:45 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:45.739230 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:45.742164 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:45.753976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:45.755289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:45.762948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.764081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.765276 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:45.766334 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.767224 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.767973 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:45.770538 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.771034 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.771465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:45.779577 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.782158 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.782964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.120731 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:46.132005 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e32690cb-648a-4415-9d08-3af832df567f tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1315 microversion: 2.1 time: 0.408211 Aug 24 04:49:46.133477 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 62/127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:45 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:46.138559 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:46.140431 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:46.147599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:46.147819 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:46.148712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:46.149898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.150708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:46.151644 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:46.152264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.174743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:46.177566 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:46.179064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c64cf7c2-51f6-40f4-9998-ba4e50dbc961 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.430244 Aug 24 04:49:46.180132 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 66/128] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:45 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:49:46.181144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=100 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:46.187030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-dd4fd60f-5cc8-4a38-b9e2-1eed9f2f4c16 req-614f2754-4bd0-4478-a187-78f705ac2ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02869b36-2e27-488f-9e94-c82e7094038d", "name": "network-vif-plugged", "status": "completed", "tag": "1c0068ae-b002-49bf-bdba-6a7c76bf094f"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:46.198819 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-dd4fd60f-5cc8-4a38-b9e2-1eed9f2f4c16 req-614f2754-4bd0-4478-a187-78f705ac2ec6 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:46.199375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-dd4fd60f-5cc8-4a38-b9e2-1eed9f2f4c16 req-614f2754-4bd0-4478-a187-78f705ac2ec6 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:46.204994 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-dd4fd60f-5cc8-4a38-b9e2-1eed9f2f4c16 req-614f2754-4bd0-4478-a187-78f705ac2ec6 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.225495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-dd4fd60f-5cc8-4a38-b9e2-1eed9f2f4c16 req-614f2754-4bd0-4478-a187-78f705ac2ec6 service nova] Creating event network-vif-plugged:1c0068ae-b002-49bf-bdba-6a7c76bf094f for instance 02869b36-2e27-488f-9e94-c82e7094038d on hv-cinder-85426 Aug 24 04:49:46.255243 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-dd4fd60f-5cc8-4a38-b9e2-1eed9f2f4c16 req-614f2754-4bd0-4478-a187-78f705ac2ec6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073545 Aug 24 04:49:46.255894 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 67/129] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:46.337151 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:46.350442 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c4194015-f7d1-4102-9909-a45fe396e5be tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.215467 Aug 24 04:49:46.351251 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 63/130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:46 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:46.362052 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:46.362764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:46.369808 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:46.370596 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:46.371331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.373210 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:46.373832 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:46.375044 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.589876 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:46.600456 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0bb8fbe4-19a6-4c8f-979d-aa670079c36d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.244071 Aug 24 04:49:46.601017 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 68/131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:46 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:46.614744 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:46.616073 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:46.627401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:46.629502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:46.630526 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.632197 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:46.633428 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:46.634058 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.819668 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:46.828852 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-55b56cea-9cfa-4b32-b89c-1eab9f39d187 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.220229 Aug 24 04:49:46.829483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 64/132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:46 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:47.164528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:47.165155 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:47.173784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.174315 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.174874 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.175643 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.176949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.177347 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.203249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:47.204465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:47.214479 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.220660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.221358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.222678 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.223502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.224538 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.484013 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:47.492845 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3f81866c-5aac-45de-8301-29f5b401fe0b tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1502 microversion: 2.1 time: 0.333915 Aug 24 04:49:47.493468 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 69/133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:47 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:47.510210 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:47.511131 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:47.519277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.519908 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.520569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.521065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:47.522051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.522336 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.523002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.543134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:47.543134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:47.543134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-fff056dd-f2f7-4974-abc1-02b42528aa83 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.343927 Aug 24 04:49:47.543501 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 65/134] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:47 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:49:47.622869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:47.623791 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:47.649020 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.649720 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.650113 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.650965 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.651681 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.652110 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.778773 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:47.797362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-31aac73b-6feb-4f3c-8afe-8ec92cc4fb81 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1362 microversion: 2.1 time: 0.292075 Aug 24 04:49:47.798208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 70/135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:47 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:47.854348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:47.855009 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:47.866886 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.867380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.868090 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.869120 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.869840 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.870507 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.876534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:47.899298 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:47.919333 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2ac6abbe-c8e7-43d8-984f-d86f1b6cb2bc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.299789 Aug 24 04:49:47.920318 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 66/136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:47 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:48.081643 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:48.092334 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a862bbbf-a16c-4270-85bb-1b182ffdbc57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.242587 Aug 24 04:49:48.093289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 71/137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:47 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:48.567654 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:48.568264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:48.576086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:48.576580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:48.577070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:48.578394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:48.578731 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:48.579157 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:48.801728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:48.808355 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-f97e2dde-1187-4b96-a458-534f975614de req-84ad1d55-e3a1-432f-881e-a5c9116e5d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79fe8ef-51d0-4ca2-9e41-940ee142b819", "name": "network-vif-plugged", "status": "completed", "tag": "4c78e02d-9548-429c-8228-3b6cbd0d044c"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:48.831809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:48.833561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:48.834856 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-96774cb2-499b-49f5-80a9-5be72d8179af tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.272035 Aug 24 04:49:48.836282 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-f97e2dde-1187-4b96-a458-534f975614de req-84ad1d55-e3a1-432f-881e-a5c9116e5d99 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:48.836767 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-f97e2dde-1187-4b96-a458-534f975614de req-84ad1d55-e3a1-432f-881e-a5c9116e5d99 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:48.837201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-f97e2dde-1187-4b96-a458-534f975614de req-84ad1d55-e3a1-432f-881e-a5c9116e5d99 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:48.842340 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 67/138] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:48 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:48.848443 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:48.849295 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:48.860735 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-f97e2dde-1187-4b96-a458-534f975614de req-84ad1d55-e3a1-432f-881e-a5c9116e5d99 service nova] Creating event network-vif-plugged:4c78e02d-9548-429c-8228-3b6cbd0d044c for instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 on hv-cinder-85426 Aug 24 04:49:48.864452 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:48.864952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:48.865388 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:48.866147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:48.866608 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:48.867031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:48.868831 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-f97e2dde-1187-4b96-a458-534f975614de req-84ad1d55-e3a1-432f-881e-a5c9116e5d99 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064873 Aug 24 04:49:48.870191 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 72/139] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:49:48.954030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:48.955112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:48.971871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:48.972671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:48.973342 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:48.974774 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:48.975532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:48.976189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.098517 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:49.118490 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9eb1df0a-c254-4e96-8601-4437419d4c3a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1548 microversion: 2.1 time: 0.273888 Aug 24 04:49:49.119441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 68/140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:48 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1548 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:49.147228 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-77548b23-4f1b-4356-8b59-1f2781d9c229 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6d55d27-9a5b-4076-b0c7-5617ea0d06fb"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:49.149937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-77548b23-4f1b-4356-8b59-1f2781d9c229 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:49.161112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-77548b23-4f1b-4356-8b59-1f2781d9c229 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.162081 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-77548b23-4f1b-4356-8b59-1f2781d9c229 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.162594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-77548b23-4f1b-4356-8b59-1f2781d9c229 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.163522 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-77548b23-4f1b-4356-8b59-1f2781d9c229 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.164037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-77548b23-4f1b-4356-8b59-1f2781d9c229 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.164539 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-77548b23-4f1b-4356-8b59-1f2781d9c229 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.206211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:49.222158 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-46988eba-e91a-45d9-bf6a-17922be8970a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.274821 Aug 24 04:49:49.223843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 73/141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:48 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:49.239637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:49.240698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:49.254415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.255563 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.258135 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.273898 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.274790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.275427 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.513214 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:49.528267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-998be2df-aaa0-4eed-bfa6-4928b1e913fb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.301065 Aug 24 04:49:49.528843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 74/142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:49 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:49.536752 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b319224e-580d-4b3c-a7b5-342d14f3f2cd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:49.537591 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b319224e-580d-4b3c-a7b5-342d14f3f2cd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:49.544297 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b319224e-580d-4b3c-a7b5-342d14f3f2cd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.545119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b319224e-580d-4b3c-a7b5-342d14f3f2cd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.546350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b319224e-580d-4b3c-a7b5-342d14f3f2cd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.547278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b319224e-580d-4b3c-a7b5-342d14f3f2cd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.551382 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b319224e-580d-4b3c-a7b5-342d14f3f2cd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.552070 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b319224e-580d-4b3c-a7b5-342d14f3f2cd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.650661 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b319224e-580d-4b3c-a7b5-342d14f3f2cd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120555 Aug 24 04:49:49.651703 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 75/143] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 24 04:49:49 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:49.847842 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-77548b23-4f1b-4356-8b59-1f2781d9c229 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "POST /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726330 Aug 24 04:49:49.849102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 69/144] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:49:49 2022] POST /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:49.868643 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:49.870324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:49.877425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.877905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.878444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.879159 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.880029 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.880362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:50.046415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:50.055474 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:50.056982 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:50.058117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6d0d7e47-37aa-4d5a-a372-bd01d3310821 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.193871 Aug 24 04:49:50.058680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 76/145] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:49 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:50.250501 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:50.251424 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:50.260937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:50.261354 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:50.261841 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:50.263456 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:50.263456 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:50.264255 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:50.443995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:50.459329 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e4222bdc-d4a4-4c4c-bbb9-dd6f3d1b728e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1368 microversion: 2.1 time: 0.214809 Aug 24 04:49:50.460545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 70/146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:50 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:50.559781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:50.560635 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:50.577817 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:50.580217 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:50.581811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:50.583757 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:50.584582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:50.585289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:50.763626 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:50.775725 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ca38331e-31ad-4e27-97c3-76eb0c2247d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.219133 Aug 24 04:49:50.790655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 77/147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:50 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:50.896213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-51466088-3aa0-437c-b665-53cb1881247f req-37e11d82-bca8-4e1a-a28d-c1965ac93acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eeaea49-9c15-4e0a-a446-98d3191293c8", "name": "network-vif-plugged", "status": "completed", "tag": "6bd895e9-3f00-4d89-aab3-7b4bbc97e62d"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:50.915292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-51466088-3aa0-437c-b665-53cb1881247f req-37e11d82-bca8-4e1a-a28d-c1965ac93acb service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:50.915752 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-51466088-3aa0-437c-b665-53cb1881247f req-37e11d82-bca8-4e1a-a28d-c1965ac93acb service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:50.916174 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-51466088-3aa0-437c-b665-53cb1881247f req-37e11d82-bca8-4e1a-a28d-c1965ac93acb service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:50.938050 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-51466088-3aa0-437c-b665-53cb1881247f req-37e11d82-bca8-4e1a-a28d-c1965ac93acb service nova] Creating event network-vif-plugged:6bd895e9-3f00-4d89-aab3-7b4bbc97e62d for instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 on hv-cinder-85426 Aug 24 04:49:50.947246 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-51466088-3aa0-437c-b665-53cb1881247f req-37e11d82-bca8-4e1a-a28d-c1965ac93acb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054562 Aug 24 04:49:50.948249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 71/148] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:51.082326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:51.082979 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:51.100323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.100857 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.101288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.102037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.102436 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.102852 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.265211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:51.278244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:51.282241 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:51.284477 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-470ea661-c272-4c86-8a55-00f523469607 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.206449 Aug 24 04:49:51.301481 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 78/149] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:51 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:51.376220 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-5a24cba0-d736-41f4-9666-d506c2315fac req-c2da5d84-12bf-4fd2-a0ef-643c59daf0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02869b36-2e27-488f-9e94-c82e7094038d", "tag": "1c0068ae-b002-49bf-bdba-6a7c76bf094f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:51.391371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-5a24cba0-d736-41f4-9666-d506c2315fac req-c2da5d84-12bf-4fd2-a0ef-643c59daf0e9 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.392240 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-5a24cba0-d736-41f4-9666-d506c2315fac req-c2da5d84-12bf-4fd2-a0ef-643c59daf0e9 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.393048 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-5a24cba0-d736-41f4-9666-d506c2315fac req-c2da5d84-12bf-4fd2-a0ef-643c59daf0e9 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.411799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-5a24cba0-d736-41f4-9666-d506c2315fac req-c2da5d84-12bf-4fd2-a0ef-643c59daf0e9 service nova] Creating event network-changed:1c0068ae-b002-49bf-bdba-6a7c76bf094f for instance 02869b36-2e27-488f-9e94-c82e7094038d on hv-cinder-85426 Aug 24 04:49:51.418267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-5a24cba0-d736-41f4-9666-d506c2315fac req-c2da5d84-12bf-4fd2-a0ef-643c59daf0e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047586 Aug 24 04:49:51.418875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 72/150] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:51.483556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:51.484191 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:51.494051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.494051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.494051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.494051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.494741 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.494741 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.685702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:51.695098 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7446110e-8380-4374-b64b-09a9d37fad6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1557 microversion: 2.1 time: 0.217669 Aug 24 04:49:51.695701 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 79/151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:51 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:51.718762 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-785f91a5-d490-450b-965d-bb9f6b34b7a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:51.719167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-785f91a5-d490-450b-965d-bb9f6b34b7a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:51.726131 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-785f91a5-d490-450b-965d-bb9f6b34b7a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.726616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-785f91a5-d490-450b-965d-bb9f6b34b7a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.727090 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-785f91a5-d490-450b-965d-bb9f6b34b7a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.727786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-785f91a5-d490-450b-965d-bb9f6b34b7a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.728231 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-785f91a5-d490-450b-965d-bb9f6b34b7a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.728644 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-785f91a5-d490-450b-965d-bb9f6b34b7a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.813872 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:51.814555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:51.816327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-785f91a5-d490-450b-965d-bb9f6b34b7a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102001 Aug 24 04:49:51.816327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 73/152] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 24 04:49:51 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:51.821325 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.822095 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.822707 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.823435 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.824154 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.824793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.984603 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:51.993071 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-dc2b6815-011a-42ef-86b4-74dc78b9dce9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.183825 Aug 24 04:49:51.993659 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 80/153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:51 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:52.314508 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:52.315661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:52.330633 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:52.331851 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:52.333251 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:52.334824 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:52.335910 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:52.337174 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:52.533831 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:52.543115 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:52.545422 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:52.547613 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d16c2dca-0337-45b2-b371-ee55fc2a7856 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.241344 Aug 24 04:49:52.548903 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 74/154] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:52 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:53.015246 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:53.016650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:53.023390 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:53.024034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:53.024581 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:53.025398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:53.026386 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:53.026922 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:53.193528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:53.206170 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-99be22d0-f5ea-4fc7-b0cd-1363e48dcd89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.196230 Aug 24 04:49:53.207426 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 81/155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:53 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:53.435710 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-8a2ddc83-f179-44b1-894c-a693c15754f8 req-229962dc-bd0e-4fd4-983f-a07b56c7ee23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79fe8ef-51d0-4ca2-9e41-940ee142b819", "tag": "4c78e02d-9548-429c-8228-3b6cbd0d044c"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:53.445955 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-8a2ddc83-f179-44b1-894c-a693c15754f8 req-229962dc-bd0e-4fd4-983f-a07b56c7ee23 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:53.446456 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-8a2ddc83-f179-44b1-894c-a693c15754f8 req-229962dc-bd0e-4fd4-983f-a07b56c7ee23 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:53.446884 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-8a2ddc83-f179-44b1-894c-a693c15754f8 req-229962dc-bd0e-4fd4-983f-a07b56c7ee23 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:53.461120 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-8a2ddc83-f179-44b1-894c-a693c15754f8 req-229962dc-bd0e-4fd4-983f-a07b56c7ee23 service nova] Creating event network-changed:4c78e02d-9548-429c-8228-3b6cbd0d044c for instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 on hv-cinder-85426 Aug 24 04:49:53.466138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-8a2ddc83-f179-44b1-894c-a693c15754f8 req-229962dc-bd0e-4fd4-983f-a07b56c7ee23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034057 Aug 24 04:49:53.466745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 75/156] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:53.573750 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:53.574380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:53.581903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:53.582892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:53.583010 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:53.583907 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:53.584413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:53.584909 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:53.751661 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:53.761855 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:53.763647 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:53.765664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e4d3ced6-9562-4b20-b3cd-a647d3d48ef5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.195896 Aug 24 04:49:53.766498 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 82/157] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:53 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:49:54.228763 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:54.229465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:54.236338 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:54.236836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:54.237270 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:54.238643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:54.238643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:54.238962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:54.394742 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:54.403696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-aa1c4a35-5222-47ae-9f77-40fe62924150 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.178919 Aug 24 04:49:54.404349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 76/158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:54 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:54.800940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:54.802325 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:54.814423 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:54.815360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:54.816203 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:54.817663 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:54.819271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:54.820111 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:55.010803 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:55.022978 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:55.025244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:55.026889 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8063fa9f-aa60-45be-acca-ce1cb6d2af27 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.236840 Aug 24 04:49:55.027518 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 83/159] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:54 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:55.425040 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:55.425620 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:55.432187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:55.432686 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:55.433112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:55.433793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:55.434264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:55.434677 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:55.573773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:55.583208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f1a269a0-740d-43cc-9947-d43a831fa154 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.161985 Aug 24 04:49:55.583880 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 77/160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:55 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:56.052934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:56.053474 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:56.059759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:56.060230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:56.060655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:56.062124 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:56.062574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:56.062987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:56.200661 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:56.210054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:56.211559 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:56.212747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-00afa119-d1ea-45e5-9d93-b35510c63dde tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.163798 Aug 24 04:49:56.213305 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 84/161] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:56 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:49:56.604794 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:56.605502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:56.613471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:56.614065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:56.614500 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:56.615190 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:56.615637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:56.616091 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:56.753816 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:56.761863 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-17e03b0b-275b-42d9-b010-8cff8932220e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.160975 Aug 24 04:49:56.762476 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 78/162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:56 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:57.241363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:57.242352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:57.253806 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:57.254673 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:57.255404 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:57.256574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:57.257365 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:57.258162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:57.462475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:57.479652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:57.483369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:57.484990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b4152fef-3204-41f0-a247-5883a69ff0c0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.251810 Aug 24 04:49:57.485931 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 85/163] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:57 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:57.790044 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:57.791223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:57.805667 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:57.807024 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:57.808076 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:57.809515 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:57.810610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:57.813439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:58.031906 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:58.043315 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8d8b0490-b1c4-4fe8-8f80-72f3320b7d71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.262378 Aug 24 04:49:58.043932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 79/164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:57 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:58.523557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:58.524352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:58.531519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:58.532102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:58.532618 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:58.533315 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:58.533784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:58.534228 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:58.751651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:58.765572 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:58.768506 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:58.769841 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8e5a46ba-c591-4f80-b3c9-f1d09dd01ed4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1408 microversion: 2.20 time: 0.251381 Aug 24 04:49:58.770497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 86/165] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:58 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:49:59.079678 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:59.081768 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:59.102345 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:59.102345 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:59.102345 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:59.102345 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:59.102949 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:59.102949 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:59.314251 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:59.330794 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c292eb3a-f39d-4b6a-a756-05f490ede3d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.258982 Aug 24 04:49:59.332008 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 80/166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:59 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:49:59.809991 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:59.810731 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:59.817920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:59.818726 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:59.819329 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:59.820053 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:59.820563 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:59.820990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:00.004211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:00.013595 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:00.016686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:00.017915 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-651722fe-e7d2-4ac5-ab81-fa7a39b75ff4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1600 microversion: 2.20 time: 0.212723 Aug 24 04:50:00.018522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 87/167] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:49:59 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:50:00.058415 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-36da2e97-005c-42d2-bfcc-7d8d510e0d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:00.059324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-36da2e97-005c-42d2-bfcc-7d8d510e0d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:00.089305 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-36da2e97-005c-42d2-bfcc-7d8d510e0d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:00.091470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-36da2e97-005c-42d2-bfcc-7d8d510e0d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:00.101383 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-36da2e97-005c-42d2-bfcc-7d8d510e0d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:00.103021 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-36da2e97-005c-42d2-bfcc-7d8d510e0d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:00.104146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-36da2e97-005c-42d2-bfcc-7d8d510e0d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:00.105125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-36da2e97-005c-42d2-bfcc-7d8d510e0d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:00.133588 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:00.359499 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:00.362461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:00.371613 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-36da2e97-005c-42d2-bfcc-7d8d510e0d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.319592 Aug 24 04:50:00.372965 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 81/168] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Aug 24 04:50:00 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-interface => generated 285 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:50:00.381050 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:00.381754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:00.382426 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:00.383310 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:00.384039 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:00.384706 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:01.450495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:01.454090 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:01.461720 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ae6ba729-d609-4780-a911-463993d8cf0c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 1.109961 Aug 24 04:50:01.462596 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 88/169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:00 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:02.509408 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:02.510314 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:02.522903 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:02.524121 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:02.525166 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:02.526625 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:02.527291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:02.527889 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:03.058179 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:03.073302 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f9b76ec4-f25e-4f2f-b994-39ac92d7ffbd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.576125 Aug 24 04:50:03.074116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 82/170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:02 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:03.169898 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-0db9c0d3-9c05-42ec-8ef9-5227a0ad1cd3 req-f073fd38-8f9e-4fb6-9456-70e2d6515e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eeaea49-9c15-4e0a-a446-98d3191293c8", "tag": "6bd895e9-3f00-4d89-aab3-7b4bbc97e62d"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:03.182081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-0db9c0d3-9c05-42ec-8ef9-5227a0ad1cd3 req-f073fd38-8f9e-4fb6-9456-70e2d6515e64 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:03.182953 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-0db9c0d3-9c05-42ec-8ef9-5227a0ad1cd3 req-f073fd38-8f9e-4fb6-9456-70e2d6515e64 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:03.183645 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-0db9c0d3-9c05-42ec-8ef9-5227a0ad1cd3 req-f073fd38-8f9e-4fb6-9456-70e2d6515e64 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:03.197839 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-0db9c0d3-9c05-42ec-8ef9-5227a0ad1cd3 req-f073fd38-8f9e-4fb6-9456-70e2d6515e64 service nova] Creating event network-changed:6bd895e9-3f00-4d89-aab3-7b4bbc97e62d for instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 on hv-cinder-85426 Aug 24 04:50:03.206057 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-0db9c0d3-9c05-42ec-8ef9-5227a0ad1cd3 req-f073fd38-8f9e-4fb6-9456-70e2d6515e64 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039555 Aug 24 04:50:03.206858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 89/171] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:50:04.120577 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:04.122777 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:04.143556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:04.144420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:04.145190 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:04.146676 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:04.147449 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:04.148698 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:04.474456 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:04.487628 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-6d028871-6ec7-499f-b46b-c5b7dfd56b71 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.376541 Aug 24 04:50:04.493897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 83/172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:04 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:05.529979 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:05.531212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:05.542930 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:05.543778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:05.544567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:05.546284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:05.546987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:05.547696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:05.752053 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:05.761966 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ce0960fc-89e7-40ee-82b7-57174883d828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.240414 Aug 24 04:50:05.763001 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 90/173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:05 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:06.790154 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:06.792550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:06.803265 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:06.804467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:06.804984 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:06.806761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:06.807524 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:06.808377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:07.053016 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:07.068606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4dff6c28-7e7b-4b97-b4ac-d1b92abd5a57 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.283824 Aug 24 04:50:07.069678 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 84/174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:06 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:08.106747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:08.108014 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:08.115293 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:08.115781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:08.116210 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:08.116930 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:08.117381 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:08.117802 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:08.329408 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:08.340264 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-db2d9ee3-43b2-43d6-92da-dd0ddb3612fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.238352 Aug 24 04:50:08.340961 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 91/175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:08 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:09.369755 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:09.370854 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:09.383342 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:09.384198 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:09.384966 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:09.386473 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:09.387197 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:09.387815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:09.640210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:09.657348 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bdacc648-42ff-49fb-937a-eeead7ccc718 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.294556 Aug 24 04:50:09.658437 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 85/176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:09 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:10.024626 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:10.025807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:10.034298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:10.034801 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:10.035611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:10.036713 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:10.037221 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:10.037779 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:10.085442 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:50:10.222888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8d6dbb09-1cf4-4fcb-b8f7-e2d692471313 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 204 len: 0 microversion: 2.1 time: 0.201260 Aug 24 04:50:10.228024 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 92/177] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:50:10 2022] DELETE /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:50:10.239206 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:10.239206 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:10.252208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:10.255281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:10.256348 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:10.257570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:10.258438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:10.259182 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:10.501721 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:10.516642 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-426205cb-e44a-4587-b4d7-69533f1483f3 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1554 microversion: 2.1 time: 0.285130 Aug 24 04:50:10.522312 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 86/178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:10 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1554 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:10.697210 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:10.698987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:10.707460 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:10.708270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:10.708838 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:10.709606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:10.710103 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:10.711023 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:10.938352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:10.948998 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c84d0748-1025-4c41-a1ab-8a5075f2d7f3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.258775 Aug 24 04:50:10.949703 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 93/179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:10 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:11.541878 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:11.542959 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:11.551827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:11.552497 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:11.552959 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:11.553833 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:11.554458 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:11.554941 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:11.732771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:11.743342 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5cfec4bf-02f9-43d5-be8c-e78c65ee1f71 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1554 microversion: 2.1 time: 0.206291 Aug 24 04:50:11.744312 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 87/180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:11 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:11.979146 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:11.979841 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:11.981728 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:11.989628 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:11.990203 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:11.990705 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:11.991513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:11.992031 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:11.992540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:12.234209 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:12.246711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-63f2e931-a2fe-4a09-8f1b-b97c8a4eed63 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.271953 Aug 24 04:50:12.247576 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 94/181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:11 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:12.778078 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:12.778695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:12.782970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=68 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:12.787932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:12.788487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:12.788937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:12.789650 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:12.790388 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:12.790554 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:12.962688 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:12.972527 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-933f8bf3-7017-4882-ad63-b6db87af2234 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1554 microversion: 2.1 time: 0.199155 Aug 24 04:50:12.973128 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 88/182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:12 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:13.286493 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:13.287580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:13.297863 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:13.298856 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:13.299678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:13.300959 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:13.302073 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:13.302877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:13.734295 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:13.750379 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9b5e3512-f19d-42c4-8a40-ee4ad2b06758 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.472500 Aug 24 04:50:13.752036 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 95/183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:13 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:13.996619 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:13.997710 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:14.016987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:14.017536 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:14.018610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:14.020466 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:14.020949 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:14.021503 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:14.198780 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-6b5efe83-fac2-4766-be6b-4a2f2c3cff13 req-adad0c0b-dfa9-489f-b89e-2603ee27f496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff3947d-3ca7-4419-81d2-7f729d51a491", "name": "network-vif-deleted", "tag": "d224240c-4f12-434d-83c9-3c34c2acf103"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:14.249863 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6b5efe83-fac2-4766-be6b-4a2f2c3cff13 req-adad0c0b-dfa9-489f-b89e-2603ee27f496 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:14.251021 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6b5efe83-fac2-4766-be6b-4a2f2c3cff13 req-adad0c0b-dfa9-489f-b89e-2603ee27f496 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:14.253228 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6b5efe83-fac2-4766-be6b-4a2f2c3cff13 req-adad0c0b-dfa9-489f-b89e-2603ee27f496 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:14.294443 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:14.310772 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-6b5efe83-fac2-4766-be6b-4a2f2c3cff13 req-adad0c0b-dfa9-489f-b89e-2603ee27f496 service nova] Creating event network-vif-deleted:d224240c-4f12-434d-83c9-3c34c2acf103 for instance dff3947d-3ca7-4419-81d2-7f729d51a491 on hv-cinder-85426 Aug 24 04:50:14.313906 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-38b4475d-b4ba-4223-8939-bf28f73b76dd tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1512 microversion: 2.1 time: 0.314715 Aug 24 04:50:14.326472 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 89/184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:13 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:14.327092 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-6b5efe83-fac2-4766-be6b-4a2f2c3cff13 req-adad0c0b-dfa9-489f-b89e-2603ee27f496 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126493 Aug 24 04:50:14.327092 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 96/185] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:50:14.787148 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:14.788893 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:14.802160 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:14.803558 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:14.804713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:14.806189 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:14.807336 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:14.808952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:15.073126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:15.087953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b1f03ef2-c463-4b15-801c-6ae9a84741a4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.311249 Aug 24 04:50:15.088887 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 90/186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:14 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:15.343992 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:15.345316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:15.356252 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:15.357604 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:15.358767 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:15.360403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:15.360988 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:15.362155 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:15.434548 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:15.436103 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:15.436925 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:15.437795 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lazy-loading 'fault' on Instance uuid dff3947d-3ca7-4419-81d2-7f729d51a491 {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:50:15.541379 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa3eb81fef84f7b8302af9ff733bbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16727c8f4db480f8fb07f96ecaa5eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:15.560555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-798b5a3b-385f-451a-911c-77f94c316569 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 200 len: 1351 microversion: 2.1 time: 0.224361 Aug 24 04:50:15.561039 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 97/187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:15 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 1351 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:16.125227 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:16.126622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:16.133916 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:16.141769 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:16.142267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:16.143243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:16.143590 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:16.144224 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:16.359939 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:16.370607 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4d5cd9b0-05a7-4608-9455-355af92e3a4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.249991 Aug 24 04:50:16.371463 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 91/188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:16 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:16.595227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:16.596017 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:16.603536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:16.604062 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:16.604496 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:16.605222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:16.605678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:16.606528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:16.625642 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] HTTP exception thrown: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Request method failure captured: Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 HTTP/1.1 Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3D_ERGY7UkaDZLEtBRuo66kmbk99bHc1aynLRkRJnUmi3ljdrD-0Rk8bruEYyGV0Tbv2gA35mgejBePMYIx1B_qKvH-BOggib0eugnU0zbXAlJy-Emb0qt1i0MVBEyUk5wDPromTgbVxB6NfqwcJT45GX4byfKZwS7IXYfw9k9Bys Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: c16727c8f4db480f8fb07f96ecaa5eb6 Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:50:16.631634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c16727c8f4db480f8fb07f96ecaa5eb6"}]}] Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: c16727c8f4db480f8fb07f96ecaa5eb6 Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-DeleteServersTestJSON-1652293035-project Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 3fa3eb81fef84f7b8302af9ff733bbfe Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-DeleteServersTestJSON-1652293035-project Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.633546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': 'dff3947d-3ca7-4419-81d2-7f729d51a491'} Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:16.634582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.636278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.637544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Returning 404 to user: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:16.637544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-931ebeb4-e00c-48f5-a1b0-498f7eca218d tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 404 len: 111 microversion: 2.1 time: 0.042956 Aug 24 04:50:16.637544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 98/189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:16 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:16.811970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:16.815964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:16.826970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:16.830600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:16.830600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:16.830600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:16.830600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:16.831659 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:16.863866 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] HTTP exception thrown: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Request method failure captured: Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491/os-volume_attachments HTTP/1.1 Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3D_ERGY7UkaDZLEtBRuo66kmbk99bHc1aynLRkRJnUmi3ljdrD-0Rk8bruEYyGV0Tbv2gA35mgejBePMYIx1B_qKvH-BOggib0eugnU0zbXAlJy-Emb0qt1i0MVBEyUk5wDPromTgbVxB6NfqwcJT45GX4byfKZwS7IXYfw9k9Bys Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: c16727c8f4db480f8fb07f96ecaa5eb6 Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:50:16.869291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c16727c8f4db480f8fb07f96ecaa5eb6"}]}] Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: c16727c8f4db480f8fb07f96ecaa5eb6 Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-DeleteServersTestJSON-1652293035-project Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 3fa3eb81fef84f7b8302af9ff733bbfe Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-DeleteServersTestJSON-1652293035-project Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.870726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'server_id': 'dff3947d-3ca7-4419-81d2-7f729d51a491'} Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:16.871542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:16.873439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:16.875068 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Returning 404 to user: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:16.875755 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-502d14e3-b40a-44a9-94f7-b350a942ab09 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071839 Aug 24 04:50:16.876773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 92/190] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:50:16 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491/os-volume_attachments => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:17.402257 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:17.404511 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:17.414828 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:17.415344 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:17.415784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:17.416502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:17.416954 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:17.417372 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:17.582041 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:17.598974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f3d449fa-e92e-428b-93b4-7eea1def305f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.201238 Aug 24 04:50:17.600587 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 99/191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:17 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:18.327708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:18.328244 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:18.335721 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:18.336910 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:18.337501 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:18.338435 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:18.339067 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:18.340021 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:18.361123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] HTTP exception thrown: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Request method failure captured: Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: DELETE /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 HTTP/1.1 Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3D_ERGY7UkaDZLEtBRuo66kmbk99bHc1aynLRkRJnUmi3ljdrD-0Rk8bruEYyGV0Tbv2gA35mgejBePMYIx1B_qKvH-BOggib0eugnU0zbXAlJy-Emb0qt1i0MVBEyUk5wDPromTgbVxB6NfqwcJT45GX4byfKZwS7IXYfw9k9Bys Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: c16727c8f4db480f8fb07f96ecaa5eb6 Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:50:18.364149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c16727c8f4db480f8fb07f96ecaa5eb6"}]}] Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: c16727c8f4db480f8fb07f96ecaa5eb6 Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-DeleteServersTestJSON-1652293035-project Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 3fa3eb81fef84f7b8302af9ff733bbfe Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-DeleteServersTestJSON-1652293035-project Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.365487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': 'dff3947d-3ca7-4419-81d2-7f729d51a491'} Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:18.366169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.367330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.370243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Returning 404 to user: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:18.371413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-dc873b6b-32fc-47cf-a386-f19a309eb572 tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 404 len: 111 microversion: 2.1 time: 0.048846 Aug 24 04:50:18.371983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 93/192] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:50:18 2022] DELETE /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:18.385469 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:18.386317 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] [instance: dff3947d-3ca7-4419-81d2-7f729d51a491] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:18.397364 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:18.397861 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:18.398383 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:18.399103 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:18.399755 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:18.400510 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:18.420667 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] HTTP exception thrown: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Request method failure captured: Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 HTTP/1.1 Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3D_ERGY7UkaDZLEtBRuo66kmbk99bHc1aynLRkRJnUmi3ljdrD-0Rk8bruEYyGV0Tbv2gA35mgejBePMYIx1B_qKvH-BOggib0eugnU0zbXAlJy-Emb0qt1i0MVBEyUk5wDPromTgbVxB6NfqwcJT45GX4byfKZwS7IXYfw9k9Bys Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: c16727c8f4db480f8fb07f96ecaa5eb6 Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:50:18.422784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c16727c8f4db480f8fb07f96ecaa5eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c16727c8f4db480f8fb07f96ecaa5eb6"}]}] Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: c16727c8f4db480f8fb07f96ecaa5eb6 Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-DeleteServersTestJSON-1652293035 Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-DeleteServersTestJSON-1652293035-project Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 3fa3eb81fef84f7b8302af9ff733bbfe Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-DeleteServersTestJSON-1652293035-project Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.424064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': 'dff3947d-3ca7-4419-81d2-7f729d51a491'} Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:18.424698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. Aug 24 04:50:18.425723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:50:18.427782 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] Returning 404 to user: Instance dff3947d-3ca7-4419-81d2-7f729d51a491 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:18.428811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2daca252-8a1b-4219-a931-fac0b2d5056e tempest-DeleteServersTestJSON-1652293035 tempest-DeleteServersTestJSON-1652293035-project] 10.222.0.60 "GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491" status: 404 len: 111 microversion: 2.1 time: 0.050642 Aug 24 04:50:18.430365 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 100/193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:18 2022] GET /compute/v2.1/servers/dff3947d-3ca7-4419-81d2-7f729d51a491 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:18.629245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:18.630319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:18.640367 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:18.641262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:18.642290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:18.643591 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:18.644609 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:18.645272 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:19.125728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:19.139151 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-285beec5-dd8f-4b01-bad4-9ee26e21391e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.518099 Aug 24 04:50:19.140243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 94/194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:18 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:20.174955 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:20.175887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:20.196913 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.197312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.197939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.198819 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.199469 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.200049 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.625351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:20.643125 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8d699a99-df5c-4247-b6cd-06f80812055a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.473995 Aug 24 04:50:20.644778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 101/195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:20 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:21.679432 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:21.681934 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:21.695558 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:21.696126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:21.697142 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:21.698413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:21.699248 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:21.700027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:22.049800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:22.067650 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-244127fe-9918-47e4-931f-a07b9564e373 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.399672 Aug 24 04:50:22.069037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 95/196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:21 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:23.102771 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:23.105508 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:23.124037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:23.129535 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:23.130382 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:23.131754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:23.132547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:23.133348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:23.467439 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:23.488371 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-07781f06-45ba-4082-86e4-fbf774096c42 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.389578 Aug 24 04:50:23.489206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 102/197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:23 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:24.518267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:24.523365 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:24.555788 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:24.556914 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:24.557975 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:24.566420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:24.572797 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:24.574282 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:25.366998 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:25.390355 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-344602df-47aa-4729-8442-933fa11ec2d0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.881971 Aug 24 04:50:25.392284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 96/198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:24 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:26.457402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:26.459781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:26.473795 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:26.475235 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:26.476464 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:26.478157 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:26.479568 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:26.481255 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:26.952402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:26.963877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e344061b-0f00-4fee-af74-107805b7e517 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.522397 Aug 24 04:50:26.965151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 103/199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:26 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:27.992663 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:27.995079 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:28.012467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:28.014044 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:28.014967 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:28.016424 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:28.017273 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:28.018055 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:28.347184 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:28.362134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a85e5c0f-5b1d-48c3-a0bd-2be8f31ad1bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1522 microversion: 2.1 time: 0.377290 Aug 24 04:50:28.363041 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 97/200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:27 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:29.390030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:29.392446 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:29.404887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:29.406280 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:29.407392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:29.409530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:29.410942 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:29.412347 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:29.692424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:29.707222 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-703321489", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "networks": [{"uuid": "4abf580d-58e4-4cc5-9958-91c977dfd0da"}]}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:29.709462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-50f0a1bb-c020-4230-818a-96027815767a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1502 microversion: 2.1 time: 0.327374 Aug 24 04:50:29.723214 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 104/201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:29 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1502 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:29.744965 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:29.745580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:29.753852 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:29.754236 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:29.754682 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:29.755616 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:29.756196 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:29.756550 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:29.822252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] validate_networks() for [('4abf580d-58e4-4cc5-9958-91c977dfd0da', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:50:30.039498 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:30.050477 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b93d8c8d-7590-40f4-bec5-fc83dfa0f8de tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1515 microversion: 2.1 time: 0.310341 Aug 24 04:50:30.051398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 105/202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:29 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:30.445234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:50:30.445738 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:50:30.446325 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:50:30.447024 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:50:30.447513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:50:30.462207 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:30.462580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:30.463206 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:30.464353 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:30.465177 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:30.465624 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:30.475497 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=92 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:30.493448 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Getting quotas for project f99e1a77e4404c48b4cfdc745668a496. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:50:30.499761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Getting quotas for user f652b0da0bf841dab4d3ed6e9e9c1f88 and project f99e1a77e4404c48b4cfdc745668a496. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:50:30.518577 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:50:30.521213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:50:30.599733 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-fb12f022-6cb8-4274-b788-9621e0a87e39 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899893 Aug 24 04:50:30.601905 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 98/203] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:50:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:50:30.617427 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c9c20e12-85af-4e85-8587-243a87e91fb6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:30.619650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c9c20e12-85af-4e85-8587-243a87e91fb6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:30.788612 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c9c20e12-85af-4e85-8587-243a87e91fb6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:30.798738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c9c20e12-85af-4e85-8587-243a87e91fb6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1218 microversion: 2.1 time: 0.189266 Aug 24 04:50:30.799698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 106/204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:30 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1218 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:31.822862 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:31.823738 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:31.848476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:31.851223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:31.854517 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:31.855848 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:31.858042 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:31.861307 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:31.863950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:31.864648 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:31.870286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:31.871034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:31.871692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:31.873916 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:31.874558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:31.875170 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:31.884265 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:31.938037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lazy-loading 'flavor' on Instance uuid c55e66d8-d307-4552-af1b-dd59c2b6f94f {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:50:32.032470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:32.046742 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-209728ed-c69c-48e8-89e5-bd10c00bd1ea tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1270 microversion: 2.1 time: 0.228152 Aug 24 04:50:32.052150 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 99/205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:31 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1270 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:32.182859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d6c0553e-2313-462f-816b-101e51e84698 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f/action" status: 200 len: 32 microversion: 2.1 time: 0.337923 Aug 24 04:50:32.187259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 107/206] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:50:31 2022] POST /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f/action => generated 32 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 04:50:32.214567 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:32.216467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:32.236204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:32.237026 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:32.237776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:32.239036 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:32.242385 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:32.243077 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:32.818829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:32.832467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b396f2d7-fec8-4ec2-aa8a-ba4b93efa7e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.635981 Aug 24 04:50:32.834107 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 100/207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:32 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:33.101739 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:33.104742 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:33.116594 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:33.117825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:33.118798 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:33.120512 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:33.121556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:33.123974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:33.299757 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:33.321630 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2e4a72bb-c141-4d73-81ea-764910ed880a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1276 microversion: 2.1 time: 0.227849 Aug 24 04:50:33.339056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 108/208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:33 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:33.863737 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:33.866853 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:33.932146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:33.938443 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:33.939490 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:33.945451 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:33.946324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:33.947046 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:34.207705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:34.220606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1bdbb70c-ccc1-4fa2-b12c-5f10a694b6bf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.365634 Aug 24 04:50:34.221477 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 101/209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:33 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:34.353638 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:34.354467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:34.382150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:34.382150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:34.382509 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:34.383358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:34.383837 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:34.384300 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:34.950757 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:34.962656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a2762af3-0d36-48d2-a4fc-5bf1c1918f86 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1318 microversion: 2.1 time: 0.613233 Aug 24 04:50:34.965336 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 109/210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:34 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:35.249908 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:35.256804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:35.280941 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:35.282973 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:35.283888 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:35.285064 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:35.285881 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:35.287729 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:35.455120 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-42655200-a726-48e1-91b7-1d1ed7acbc12 req-24254465-e46f-4e31-bfaa-97d04d5f6abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35023e55-459b-4d6f-be1d-cdd01a5b318c", "tag": "dfb279cf-9929-4520-adae-43f66b8885aa"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:35.486880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-42655200-a726-48e1-91b7-1d1ed7acbc12 req-24254465-e46f-4e31-bfaa-97d04d5f6abe service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:35.488552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-42655200-a726-48e1-91b7-1d1ed7acbc12 req-24254465-e46f-4e31-bfaa-97d04d5f6abe service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:35.489671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-42655200-a726-48e1-91b7-1d1ed7acbc12 req-24254465-e46f-4e31-bfaa-97d04d5f6abe service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:35.515322 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-42655200-a726-48e1-91b7-1d1ed7acbc12 req-24254465-e46f-4e31-bfaa-97d04d5f6abe service nova] Creating event network-changed:dfb279cf-9929-4520-adae-43f66b8885aa for instance 35023e55-459b-4d6f-be1d-cdd01a5b318c on hv-cinder-85426 Aug 24 04:50:35.526420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-42655200-a726-48e1-91b7-1d1ed7acbc12 req-24254465-e46f-4e31-bfaa-97d04d5f6abe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086750 Aug 24 04:50:35.528928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 110/211] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:50:35.768371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:35.777517 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-756c562e-d7ee-46fb-82f9-c23094005cb5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.535555 Aug 24 04:50:35.791898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 102/212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:35 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:35.986590 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:35.987189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:35.994067 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:35.994555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:35.995155 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:35.996207 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:35.997127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:35.997615 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:36.198544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:36.211220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-129b15b8-812f-4bde-a6ed-e3a8863c49f8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1318 microversion: 2.1 time: 0.228941 Aug 24 04:50:36.211815 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 111/213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:35 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:36.801025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:36.801894 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:36.813187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:36.814645 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:36.815909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:36.817708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:36.818725 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:36.819466 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:37.057715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:37.070613 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4d1d2555-7183-49e5-bcc9-ecde9709d9ed tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.273443 Aug 24 04:50:37.071317 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 103/214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:36 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:37.254211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:37.255488 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:37.266916 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:37.267790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:37.268580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:37.269881 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:37.270783 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:37.271554 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:37.568856 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:37.599352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-839aec2e-69c2-4a75-8950-01c8c975743d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1318 microversion: 2.1 time: 0.353143 Aug 24 04:50:37.600444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 112/215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:37 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:38.105305 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:38.107464 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:38.123715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:38.124229 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:38.124719 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:38.131738 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:38.137902 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:38.139022 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:38.627326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:38.628762 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:38.640357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:38.641162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:38.642115 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:38.643293 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:38.643794 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:38.644223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:38.814032 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:38.850140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-263bbf45-8ccb-473d-91f5-6216416cb59a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.748310 Aug 24 04:50:38.855360 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 104/216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:38 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:39.050043 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:39.067322 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-12f9e335-957a-4f5e-a8be-d665f50b99d8 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1318 microversion: 2.1 time: 0.447693 Aug 24 04:50:39.081310 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 113/217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:38 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:39.879951 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:39.880686 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:39.888276 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:39.888771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:39.889207 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:39.889920 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:39.890445 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:39.890878 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:40.106184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:40.108303 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:40.140086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:40.151960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:40.152476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:40.153610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:40.156339 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-182d00c5-be1b-4b65-a09c-1a72c35eba76 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.282135 Aug 24 04:50:40.158174 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 105/218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:39 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:40.159171 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:40.159784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:40.160233 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:40.569003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:40.588033 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-b35a890f-b190-4e45-a5cf-480444fb4030 req-116de892-61e6-4195-8170-86c8ad3ce72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35023e55-459b-4d6f-be1d-cdd01a5b318c", "name": "network-vif-plugged", "status": "completed", "tag": "dfb279cf-9929-4520-adae-43f66b8885aa"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:40.588430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-613bcde1-062a-4b3a-b335-49cb54567cc4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1318 microversion: 2.1 time: 0.489597 Aug 24 04:50:40.589465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 114/219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:40 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:40.606713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:40.610063 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=6 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:40.640263 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-b35a890f-b190-4e45-a5cf-480444fb4030 req-116de892-61e6-4195-8170-86c8ad3ce72e service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:40.641009 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-b35a890f-b190-4e45-a5cf-480444fb4030 req-116de892-61e6-4195-8170-86c8ad3ce72e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:40.641592 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-b35a890f-b190-4e45-a5cf-480444fb4030 req-116de892-61e6-4195-8170-86c8ad3ce72e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:40.685293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-b35a890f-b190-4e45-a5cf-480444fb4030 req-116de892-61e6-4195-8170-86c8ad3ce72e service nova] Creating event network-vif-plugged:dfb279cf-9929-4520-adae-43f66b8885aa for instance 35023e55-459b-4d6f-be1d-cdd01a5b318c on hv-cinder-85426 Aug 24 04:50:40.705241 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-b35a890f-b190-4e45-a5cf-480444fb4030 req-116de892-61e6-4195-8170-86c8ad3ce72e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123543 Aug 24 04:50:40.706232 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 106/220] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:50:41.190312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:41.191430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:41.198696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:41.203355 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:41.204909 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:41.208284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:41.210316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:41.211574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:41.212452 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:41.536614 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:41.575108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-615331ce-f632-46c4-8f72-78887b5820ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.389318 Aug 24 04:50:41.590038 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 115/221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:41 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:41.619515 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:41.620392 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:41.649351 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:41.650985 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:41.651725 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:41.653827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:41.654451 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:41.654983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:41.911964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:41.931561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e3ef6059-854e-48fb-b73c-a0355f245eb7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1318 microversion: 2.1 time: 0.317592 Aug 24 04:50:41.933683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 107/222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:41 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:42.609647 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:42.614809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:42.626879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=48 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:42.641422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.642696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.643707 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:42.645197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.648077 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.649130 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:42.944522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:42.959146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:42.959985 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:42.967160 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a67be111-ab92-40b5-bb6c-76434f6e4690 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.367257 Aug 24 04:50:42.969154 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 116/223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:42 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:42.973371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:42.977611 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.978162 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.978604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:42.979336 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.979788 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.980210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:43.257761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:43.268775 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0457d043-5f52-4ef2-8509-fe0f9bc732b7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1507 microversion: 2.1 time: 0.314697 Aug 24 04:50:43.269823 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 108/224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:42 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:44.046502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:44.049859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:44.068420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:44.070119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:44.071361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:44.072974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:44.074146 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:44.075796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:44.421912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:44.440155 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c9cabf47-f48e-478d-a382-bd2742227725 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.411258 Aug 24 04:50:44.442363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 117/225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:44 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:45.484351 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:45.486272 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:45.497904 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:45.499022 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:45.499773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:45.500708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:45.501253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:45.501844 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:45.816803 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:45.837152 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3eb66986-367c-43c4-ba90-6ba35fe5d3f6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.359648 Aug 24 04:50:45.838420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 109/226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:45 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:46.869698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:46.871786 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:46.887669 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:46.888907 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:46.889911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:46.891411 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:46.892871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:46.893791 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:47.104239 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:47.118673 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8390dbbe-4014-413b-a956-1283648f45f8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.258121 Aug 24 04:50:47.119588 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 118/227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:46 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:48.156635 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:48.157338 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:48.166814 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:48.167409 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:48.168374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:48.169236 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:48.169840 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:48.171075 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:48.384514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:48.402422 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-03d9360b-e0d1-41a6-9ef6-5a62804d11d1 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.251965 Aug 24 04:50:48.404036 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 110/228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:48 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:49.431079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:49.432553 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:49.452648 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:49.453664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:49.454195 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:49.455339 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:49.455878 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:49.456623 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:49.674226 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:49.686359 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-282ae02b-0d60-436a-925e-b7e4956b0a36 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.259302 Aug 24 04:50:49.687061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 119/229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:49 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:50.726583 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:50.729439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:50.760343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:50.760343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:50.761103 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:50.762303 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:50.762956 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:50.763426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:50.801347 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-495abe66-ad9b-48c8-8690-2e1483ddc6c5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:50.805712 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-495abe66-ad9b-48c8-8690-2e1483ddc6c5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:50.835872 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-495abe66-ad9b-48c8-8690-2e1483ddc6c5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:50.837011 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-495abe66-ad9b-48c8-8690-2e1483ddc6c5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:50.837949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-495abe66-ad9b-48c8-8690-2e1483ddc6c5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:50.839460 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-495abe66-ad9b-48c8-8690-2e1483ddc6c5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:50.840882 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-495abe66-ad9b-48c8-8690-2e1483ddc6c5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:50.858054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-495abe66-ad9b-48c8-8690-2e1483ddc6c5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:50.964179 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-495abe66-ad9b-48c8-8690-2e1483ddc6c5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/ips" status: 200 len: 146 microversion: 2.1 time: 0.180196 Aug 24 04:50:50.971698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 120/230] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:50:50 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/ips => generated 146 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:50:51.049004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:51.061643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-35ce3198-9496-4100-b242-62a133cb4bfc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.343634 Aug 24 04:50:51.063583 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 111/231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:50 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:52.098589 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:52.099496 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:52.107505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:52.107984 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:52.108608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:52.109351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:52.109809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:52.110276 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:52.390614 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:52.410872 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2d2b7ed5-42cb-4496-a1be-c5e63ccdca3f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.316887 Aug 24 04:50:52.411570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 121/232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:52 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:53.448187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:53.449990 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:53.459267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:53.459971 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:53.460689 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:53.461849 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:53.462545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:53.463479 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:53.680022 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:53.692449 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2fa31d0e-01ce-4939-89a6-a64cb355f96a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.260230 Aug 24 04:50:53.693417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 112/233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:53 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:54.732826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:54.733981 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:54.747327 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.748560 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.749301 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:54.750291 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.751146 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.753406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:54.977674 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:54.981472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:54.994670 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0446b01c-7493-4616-a1ea-eb73015d6086 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.270435 Aug 24 04:50:54.999195 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 122/234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:54 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:56.033334 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:56.034512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:56.045710 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:56.046262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:56.046709 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:56.047748 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:56.048374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:56.048695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:56.335543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:56.351755 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-038cc462-a006-485f-97cf-b4856b32e12d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.325930 Aug 24 04:50:56.353728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 113/235] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:56 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:57.393266 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:57.395638 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:57.409683 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:57.411123 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:57.413600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:57.415094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:57.416573 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:57.418054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:57.799491 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:57.809115 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5991a87a-efd4-401c-b275-c20bff0c7862 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.423467 Aug 24 04:50:57.810699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 123/236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:57 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:58.215302 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-eab6603b-628e-43b5-87a6-d81d4fcbb1c0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4568723-b559-4292-969b-2032eb3e5ab5"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:58.218764 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-eab6603b-628e-43b5-87a6-d81d4fcbb1c0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:58.226145 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-eab6603b-628e-43b5-87a6-d81d4fcbb1c0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:58.226650 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-eab6603b-628e-43b5-87a6-d81d4fcbb1c0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:58.227146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-eab6603b-628e-43b5-87a6-d81d4fcbb1c0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:58.228063 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-eab6603b-628e-43b5-87a6-d81d4fcbb1c0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:58.228745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-eab6603b-628e-43b5-87a6-d81d4fcbb1c0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:58.229179 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-eab6603b-628e-43b5-87a6-d81d4fcbb1c0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:58.683539 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:58.701464 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-eab6603b-628e-43b5-87a6-d81d4fcbb1c0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490709 Aug 24 04:50:58.702447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 114/237] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:50:58 2022] POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:50:58.836519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:58.837763 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:58.849312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:58.850527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:58.851710 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:58.852658 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:58.853293 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:58.854235 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:59.095481 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:59.107189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f239e1be-ba8a-4f4b-b358-925a2fa094f5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.276393 Aug 24 04:50:59.108503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 124/238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:58 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:00.144061 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:00.144937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:00.160809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:00.161307 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:00.161753 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:00.162531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:00.163023 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:00.163419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:00.440231 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:00.456095 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-84715cda-9acb-4d95-b93a-89e06ed5e5ab tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.316901 Aug 24 04:51:00.457430 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 115/239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:00 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:01.266780 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f954280a-b832-4965-b2c0-9bb9ecccc441 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:01.277554 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f954280a-b832-4965-b2c0-9bb9ecccc441 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:01.278559 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f954280a-b832-4965-b2c0-9bb9ecccc441 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:01.279111 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f954280a-b832-4965-b2c0-9bb9ecccc441 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:01.397781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f954280a-b832-4965-b2c0-9bb9ecccc441 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Going to try to stop instance {{(pid=127415) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 04:51:01.483756 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:01.484636 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:01.496470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:01.502802 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:01.504417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:01.505471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:01.508790 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:01.509518 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:01.525720 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f954280a-b832-4965-b2c0-9bb9ecccc441 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/action" status: 202 len: 0 microversion: 2.1 time: 0.262655 Aug 24 04:51:01.538472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 125/240] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:51:01 2022] POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:51:01.565230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:01.566330 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:01.577397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:01.578147 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:01.578684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:01.579684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:01.580405 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:01.580995 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:01.891797 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:01.904128 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e415115b-b7ab-4fef-904e-4d87800fb800 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.427516 Aug 24 04:51:01.915323 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 116/241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:01 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:02.009349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:02.046384 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7f9ca13e-9366-4f75-826f-bf91cc310aee tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.503273 Aug 24 04:51:02.048336 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 126/242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:01 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:02.094041 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-6c90a596-74a6-4964-a3b0-b3cf4cde3590 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:02.096344 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-6c90a596-74a6-4964-a3b0-b3cf4cde3590 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:02.109233 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6c90a596-74a6-4964-a3b0-b3cf4cde3590 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:02.110078 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6c90a596-74a6-4964-a3b0-b3cf4cde3590 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:02.110783 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6c90a596-74a6-4964-a3b0-b3cf4cde3590 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:02.111807 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6c90a596-74a6-4964-a3b0-b3cf4cde3590 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:02.112506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6c90a596-74a6-4964-a3b0-b3cf4cde3590 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:02.113799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6c90a596-74a6-4964-a3b0-b3cf4cde3590 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:02.163438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-6c90a596-74a6-4964-a3b0-b3cf4cde3590 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/ips" status: 200 len: 149 microversion: 2.1 time: 0.079792 Aug 24 04:51:02.164725 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 117/243] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:51:02 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/ips => generated 149 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:02.931618 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:02.934469 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:02.974177 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:02.974925 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:02.975431 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:02.976223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:02.977502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:02.978251 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:03.092406 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:03.104898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:03.158191 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:03.161002 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:03.162202 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:03.164825 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:03.166169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:03.167911 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:03.638458 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:03.657330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-007a84a8-33fc-42d6-8f39-3a4759da99a7 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.574803 Aug 24 04:51:03.658668 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 118/244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:03 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:03.679692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:03.689383 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-df1c29ec-7c74-49bc-bd61-874e800240ec tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.766078 Aug 24 04:51:03.693804 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 127/245] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:02 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:04.096556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-771bf00d-6c8c-4192-be30-cafdd54d9a8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b0871e0-c3bf-45f6-bd6b-12e04dc33b83"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:04.099423 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-771bf00d-6c8c-4192-be30-cafdd54d9a8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:04.112930 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-771bf00d-6c8c-4192-be30-cafdd54d9a8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:04.113928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-771bf00d-6c8c-4192-be30-cafdd54d9a8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:04.115609 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-771bf00d-6c8c-4192-be30-cafdd54d9a8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:04.116399 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-771bf00d-6c8c-4192-be30-cafdd54d9a8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:04.116875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-771bf00d-6c8c-4192-be30-cafdd54d9a8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:04.117301 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-771bf00d-6c8c-4192-be30-cafdd54d9a8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:04.646684 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-771bf00d-6c8c-4192-be30-cafdd54d9a8c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555785 Aug 24 04:51:04.652615 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 119/246] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:51:04 2022] POST /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 194 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:04.707336 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:04.709083 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:04.718259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:04.719073 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:04.720271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:04.721417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:04.722153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:04.722774 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:04.744927 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:04.746101 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:04.773531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:04.779434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:04.780004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:04.780770 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:04.788809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:04.789795 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:05.503614 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:05.533489 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-367c2424-a39e-4aa6-b554-659025340b79 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.799365 Aug 24 04:51:05.534506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 120/247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:04 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:05.635608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:05.653399 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a6028369-3154-408c-9c9c-49c6b4390486 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.951909 Aug 24 04:51:05.654901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 128/248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:04 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:06.575089 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:06.576739 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:06.588194 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:06.589026 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:06.589693 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:06.591838 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:06.592986 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:06.593653 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:06.678728 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:06.680079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:06.690028 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:06.690766 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:06.691659 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:06.692704 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:06.693321 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:06.693887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:07.147280 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:07.188774 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:07.196601 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-18c8a0a0-f4e1-4b36-82af-bf92eb020d30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.628258 Aug 24 04:51:07.201605 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 121/249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:06 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:07.216037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a5c9ce26-a21f-4337-9860-9af2d0275f82 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.541534 Aug 24 04:51:07.217582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 129/250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:06 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:08.229097 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:08.232499 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:08.242915 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:08.244524 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:08.265736 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:08.267657 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:08.268394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:08.269120 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:08.269901 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:08.270632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:08.272887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:08.274069 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:08.275171 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:08.281398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:08.282606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:08.288558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:08.904599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:08.929484 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:08.937949 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-aa71f00b-b7bb-42ab-87ce-3ec310be52e5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.720199 Aug 24 04:51:08.950869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 122/251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:08 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:08.952212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4b583c57-06a3-4902-b957-fd132b92461b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.717304 Aug 24 04:51:08.966813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 130/252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:08 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:09.975009 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:10.001112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:10.002772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:10.007275 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:10.029636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:10.031734 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:10.032901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:10.034336 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:10.036218 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:10.036905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:10.041712 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:10.044651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:10.045359 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:10.047816 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:10.051825 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:10.052457 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:10.564981 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:10.585040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-423e5dad-1d18-4729-9ee1-80c06d42a12e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.606887 Aug 24 04:51:10.599584 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 131/253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:09 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:10.617429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:10.630197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0a2c8e31-0e52-458b-a332-7f946ef922e5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:10.631509 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0a2c8e31-0e52-458b-a332-7f946ef922e5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:10.631821 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-fea09ae3-7ebf-46d5-aa38-9e67299fe5d6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.662992 Aug 24 04:51:10.643510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 123/254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:09 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:10.665112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a2c8e31-0e52-458b-a332-7f946ef922e5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:10.668880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a2c8e31-0e52-458b-a332-7f946ef922e5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:10.670165 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a2c8e31-0e52-458b-a332-7f946ef922e5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:10.675093 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a2c8e31-0e52-458b-a332-7f946ef922e5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:10.680469 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a2c8e31-0e52-458b-a332-7f946ef922e5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:10.683758 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a2c8e31-0e52-458b-a332-7f946ef922e5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:10.785115 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0a2c8e31-0e52-458b-a332-7f946ef922e5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/ips" status: 200 len: 152 microversion: 2.20 time: 0.180418 Aug 24 04:51:10.794161 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 132/255] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Aug 24 04:51:10 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/ips => generated 152 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:51:11.612306 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:11.612772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:11.633168 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:11.634046 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:11.637174 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:11.638267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:11.640613 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:11.641251 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:11.659027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:11.659850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:11.676220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:11.676865 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:11.678153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:11.679364 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:11.680051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:11.680754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:12.273904 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:12.307562 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:12.319017 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-48f8236c-9d37-4f56-a382-891ce63a48a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.692257 Aug 24 04:51:12.323626 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 124/256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:11 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:12.359203 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-68929430-0b7c-46ae-8090-6da252b54111 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1501 microversion: 2.1 time: 0.692921 Aug 24 04:51:12.362276 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 133/257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:11 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1501 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:12.397705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a29db13-23f9-48f5-9f48-9c7fb1ce7167"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:12.401845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:12.434502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:12.435622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:12.436470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:12.437669 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:12.438564 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:12.442124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:12.529214 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] HTTP exception thrown: Cannot 'attach_volume' instance c55e66d8-d307-4552-af1b-dd59c2b6f94f while it is in vm_state rescued Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Request method failure captured: Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: POST /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f/os-volume_attachments HTTP/1.1 Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 74 Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa20IyEzD7U6F30SSskJS5-VXIlAQDQ0K19oWqsUTewrcIbAUWR7Aa4Zzl27820bwdwcAamNBDZvl1f_fj13FMS6YF8vnY0uVTe4hRADGrPARVoyHJZb11Pd6NwA_3kVyPjQEJcmGyj1ZzRHYY-6VD3wIiyVmXmgLBI9a6Fr0LxiYxo Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:51:12.540846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1a1f238eb4f34d44ac93b85181ad7001"}]}] Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 3d5408f9ada24654839e479c7fe385ce Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {"volumeAttachment": {"volumeId": "8a29db13-23f9-48f5-9f48-9c7fb1ce7167"}} Aug 24 04:51:12.542660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Cannot 'attach_volume' instance c55e66d8-d307-4552-af1b-dd59c2b6f94f while it is in vm_state rescued Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'server_id': 'c55e66d8-d307-4552-af1b-dd59c2b6f94f', 'body': {'volumeAttachment': {'volumeId': '8a29db13-23f9-48f5-9f48-9c7fb1ce7167'}}} Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c55e66d8-d307-4552-af1b-dd59c2b6f94f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:51:12.543556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c55e66d8-d307-4552-af1b-dd59c2b6f94f while it is in vm_state rescued Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:12.544964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:12.546297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:51:12.546297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:51:12.546297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c55e66d8-d307-4552-af1b-dd59c2b6f94f while it is in vm_state rescued Aug 24 04:51:12.546297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:51:12.546297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Returning 409 to user: Cannot 'attach_volume' instance c55e66d8-d307-4552-af1b-dd59c2b6f94f while it is in vm_state rescued {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:51:12.546297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d11d76a5-6b87-4567-a868-ddbe19acea17 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.149686 Aug 24 04:51:12.546297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 125/258] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:51:12 2022] POST /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f/os-volume_attachments => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 04:51:12.553855 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6f55f1aa-890c-4f9b-b0c3-817915fd181d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:12.554548 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6f55f1aa-890c-4f9b-b0c3-817915fd181d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:12.566913 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f55f1aa-890c-4f9b-b0c3-817915fd181d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:12.567821 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f55f1aa-890c-4f9b-b0c3-817915fd181d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:12.568566 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f55f1aa-890c-4f9b-b0c3-817915fd181d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:12.569663 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f55f1aa-890c-4f9b-b0c3-817915fd181d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:12.570398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f55f1aa-890c-4f9b-b0c3-817915fd181d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:12.571066 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f55f1aa-890c-4f9b-b0c3-817915fd181d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:12.756711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6f55f1aa-890c-4f9b-b0c3-817915fd181d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f/action" status: 202 len: 0 microversion: 2.1 time: 0.206038 Aug 24 04:51:12.759970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 134/259] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:51:12 2022] POST /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:51:12.771592 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:12.772378 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:12.796745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:12.798638 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:12.799846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:12.801147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:12.802375 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:12.808026 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:13.257938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5f7895c8-c311-4592-ba6a-0d643e7dff46 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: .version_select at 0x7fb052623dc0>, body: {"keypair": {"name": "tempest-keypair-1755331327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdFTHI9kDCRXzgfWmJEzxa8L2evQiI2+oLO02qb80n8At1J87xi2rhjXHc7GXZXdH2HjhHcXxBXrlBMiOW1SoTF12ohYFMxZrS8fyf0VDvZD8DamUW+WoX/v8gQVAaZqg=="}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:13.285165 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=38 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:13.334702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-5f7895c8-c311-4592-ba6a-0d643e7dff46 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:13.345303 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-5f7895c8-c311-4592-ba6a-0d643e7dff46 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for user b847f94abee2439fab2f85f48abd7707 and project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:13.418928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5f7895c8-c311-4592-ba6a-0d643e7dff46 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166536 Aug 24 04:51:13.419557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 135/260] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:51:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:51:13.429287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:13.434042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:13.458344 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:13.458920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:13.459374 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:13.459562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:13.460160 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:13.462724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:13.465277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:13.471336 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-caf50854-2238-4dc4-a29c-0a96419df6d3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1509 microversion: 2.1 time: 0.706335 Aug 24 04:51:13.477429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 126/261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:12 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1509 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:13.707875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b15b7cfd-9095-4383-8cf0-f0f9c05c65a9 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ad8e65a-eff2-40c4-b8cf-67da8747fd20", "device": "/dev/sdb"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:13.711458 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b15b7cfd-9095-4383-8cf0-f0f9c05c65a9 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:13.715430 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=38 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:13.736407 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b15b7cfd-9095-4383-8cf0-f0f9c05c65a9 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:13.738778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b15b7cfd-9095-4383-8cf0-f0f9c05c65a9 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:13.740708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b15b7cfd-9095-4383-8cf0-f0f9c05c65a9 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:13.744560 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b15b7cfd-9095-4383-8cf0-f0f9c05c65a9 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:13.745654 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b15b7cfd-9095-4383-8cf0-f0f9c05c65a9 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:13.747177 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b15b7cfd-9095-4383-8cf0-f0f9c05c65a9 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:13.920356 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:13.938620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f433fcbe-d722-4eb9-9394-cac6af0e9f03 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.513344 Aug 24 04:51:13.947194 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 136/262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:13 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:13.966210 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:13.968777 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:13.986494 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:13.987362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:13.988757 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:13.992079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:13.992851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:13.993436 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:14.058697 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lazy-loading 'flavor' on Instance uuid 5eeaea49-9c15-4e0a-a446-98d3191293c8 {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:51:14.211284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:14.494631 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b15b7cfd-9095-4383-8cf0-f0f9c05c65a9 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "POST /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.790827 Aug 24 04:51:14.495519 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 127/263] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:51:13 2022] POST /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:51:14.517033 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:14.522366 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:14.554503 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:14.556926 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:14.557450 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:14.558577 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:14.563351 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:14.570879 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:14.726071 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-14d8ccb8-34bc-49c7-a579-6579e76f34a0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/action" status: 202 len: 0 microversion: 2.20 time: 0.768746 Aug 24 04:51:14.737659 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 137/264] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 24 04:51:13 2022] POST /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:51:14.766875 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:14.774104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:14.803733 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:14.821888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:14.822740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:14.830878 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:14.831987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:14.832644 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:15.407713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:15.421456 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a22b4644-8257-4e9c-bb54-ab797b6a6fa6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1509 microversion: 2.1 time: 0.908954 Aug 24 04:51:15.422911 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 128/265] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:14 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1509 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:15.444125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:15.445355 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:15.461152 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:15.462100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:15.462776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:15.463936 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:15.465879 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:15.466699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:15.498471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:15.977050 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:15.991264 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:16.000793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:16.004696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-41439aa2-51e2-4e88-9279-5b7b123af50a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 1.253707 Aug 24 04:51:16.012140 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 138/266] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:14 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:16.462716 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:16.463349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:16.486528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:16.487041 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:16.487591 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:16.489582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:16.490096 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:16.490542 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:16.746513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:16.756531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8060703b-21ae-4f5a-8e29-c57ab3548f1b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 1.331965 Aug 24 04:51:16.766692 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 129/267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:15 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:17.044583 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:17.048809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:17.069507 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:17.070070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:17.071262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:17.075062 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:17.075703 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:17.076298 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:17.081523 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:17.097271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e3b6fe6a-a279-4c60-9f6b-b13bfdc4d77e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1509 microversion: 2.1 time: 0.639793 Aug 24 04:51:17.110851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 139/268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:16 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1509 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:17.363318 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:17.374327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:17.376689 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:17.378199 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-fbd7e756-0fa7-4cb3-8b58-b6799f36d87e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.342600 Aug 24 04:51:17.379206 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 130/269] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:17 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:17.789643 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:17.790345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:17.804256 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:17.804762 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:17.805206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:17.805942 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:17.806448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:17.807007 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:18.123705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:18.124995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:18.151675 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:18.152898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:18.153571 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:18.154650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:18.158371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:18.159205 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:18.159954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:18.174314 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2f2b1f74-95c0-4f55-917c-0a6094e861df tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.388785 Aug 24 04:51:18.178090 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 140/270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:17 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:18.410180 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:18.411266 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:18.439505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:18.441429 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:18.441429 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:18.442087 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:18.442665 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:18.443751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:18.740521 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:18.766817 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:18.779378 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:18.785148 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8de173eb-594a-4465-81ad-f8ab06b58477 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.375597 Aug 24 04:51:18.785847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 141/271] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:18 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:51:18.887959 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:18.899207 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4315412e-4195-40f5-9383-30b48ddb229a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1515 microversion: 2.1 time: 0.780870 Aug 24 04:51:18.900294 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 131/272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:18 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1515 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:19.199092 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:19.200824 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:19.217618 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:19.218474 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:19.219314 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:19.222397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:19.224669 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:19.226392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:19.451836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-443178434", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bc1ad55-5d65-47b3-8be9-9d83a75436be"}], "security_groups": [{"name": "tempest-securitygroup--1585158872"}], "key_name": "tempest-keypair-1755331327", "user_data": "}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:20.029444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] validate_networks() for [('5bc1ad55-5d65-47b3-8be9-9d83a75436be', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:51:20.177975 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:20.194872 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e61d27cc-7025-4706-ad85-f669a3babe6b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 1.000871 Aug 24 04:51:20.195473 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 142/273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:19 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:20.211026 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:20.214139 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:20.249831 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:20.251259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:20.252459 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:20.256293 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:20.258584 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:20.261114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:20.967460 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:20.994074 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:21.000020 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:21.006340 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-fa58055b-2413-4265-ad3b-3f3c632e2943 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.807542 Aug 24 04:51:21.012108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 143/274] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:20 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:21.220537 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:21.221955 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:21.250955 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:21.252256 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:21.254220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:21.255381 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:21.258014 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:21.261366 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:22.022363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:22.053862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-80ef0ed5-2ec4-4736-957d-f767b4c16f39 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1723 microversion: 2.1 time: 0.838706 Aug 24 04:51:22.056489 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 144/275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:21 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1723 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:22.063205 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:22.064860 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:22.074088 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:22.075064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:22.075764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:22.077703 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:22.078668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:22.079329 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:22.222857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:51:22.223677 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:51:22.224497 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:51:22.225929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:51:22.226736 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:51:22.268923 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:22.272884 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:22.274067 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:22.278170 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:22.280585 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:22.281519 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:22.380478 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:22.392468 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for user b847f94abee2439fab2f85f48abd7707 and project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:22.417254 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:51:22.432931 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:51:22.567957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ad6e022c-5039-4e83-9887-64c4b32fb933 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.123039 Aug 24 04:51:22.569024 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 132/276] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:51:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 3125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:51:22.585352 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8468728b-1713-44ec-be46-5910c7c85960 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:22.586649 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8468728b-1713-44ec-be46-5910c7c85960 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:23.184545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8468728b-1713-44ec-be46-5910c7c85960 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:23.197559 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8468728b-1713-44ec-be46-5910c7c85960 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1241 microversion: 2.1 time: 0.615878 Aug 24 04:51:23.214045 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 133/277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:22 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1241 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:23.214045 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b3d49dea-bf41-4ef5-93d9-938dafd8fa2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'create', calling method: .version_select at 0x7fb050b388b0>, body: {"keypair": {"name": "tempest-keypair-202614937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQLd8fdQjHG6ckDQGXKyv0dEPb+qjwsORSFIrLzUW0c8+/hI8pDnz7Sb5wWBlLDJNnVHO5ViZn5MzRAJWPWho4xs1qEfdp21KGGwWWCXZxhDMaQiRWhkLdb65QGDGHidQ=="}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:23.303815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-b3d49dea-bf41-4ef5-93d9-938dafd8fa2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Getting quotas for project 1a1f238eb4f34d44ac93b85181ad7001. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:23.316319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-b3d49dea-bf41-4ef5-93d9-938dafd8fa2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Getting quotas for user 3d5408f9ada24654839e479c7fe385ce and project 1a1f238eb4f34d44ac93b85181ad7001. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:23.363230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=4 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:23.426323 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b3d49dea-bf41-4ef5-93d9-938dafd8fa2a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.223463 Aug 24 04:51:23.430632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 134/278] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:51:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:23.460600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:23.463992 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:23.517945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:23.519628 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:23.523722 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:23.526881 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:23.528582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:23.530489 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:24.266978 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:24.289047 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:24.294569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:24.305588 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-cff9c423-854d-46de-b707-9018be30fe62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 2.238899 Aug 24 04:51:24.306587 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 145/279] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:22 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:24.324663 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:24.327008 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:24.350617 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:24.351534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:24.352409 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:24.355134 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:24.355857 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:24.357181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:24.897362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:24.916161 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-abc65915-b718-4c9d-a286-e60e14b6cdd1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1237 microversion: 2.1 time: 0.604395 Aug 24 04:51:24.919765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 146/280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:24 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1237 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:25.331974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:25.347800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-494460a2-768d-4e9e-8a06-14f04d3701a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1700 microversion: 2.1 time: 1.913360 Aug 24 04:51:25.348408 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 135/281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:23 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1700 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:25.356684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:25.357312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:25.366945 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:25.367589 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:25.368225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:25.369016 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:25.370091 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:25.370880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:25.379848 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-dc839e48-e3c9-43ab-ab17-bea16418cf8e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:25.405172 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dc839e48-e3c9-43ab-ab17-bea16418cf8e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:25.405761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dc839e48-e3c9-43ab-ab17-bea16418cf8e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:25.406234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dc839e48-e3c9-43ab-ab17-bea16418cf8e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:25.650472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:25.674694 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-dc839e48-e3c9-43ab-ab17-bea16418cf8e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Going to try to start instance {{(pid=127416) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 04:51:25.687328 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:25.701339 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:25.703044 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-93d37905-5cc1-47ac-b055-756139e13445 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.351967 Aug 24 04:51:25.708960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 147/282] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:25 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:25.780848 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-dc839e48-e3c9-43ab-ab17-bea16418cf8e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/action" status: 202 len: 0 microversion: 2.1 time: 0.405044 Aug 24 04:51:25.782824 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 136/283] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:51:25 2022] POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:51:25.792972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:25.793935 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:25.808046 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:25.809371 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:25.810300 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:25.811687 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:25.812295 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:25.813247 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:25.948404 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:25.949468 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:25.974210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:25.975123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:25.976181 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:25.980451 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:25.981141 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:25.981898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:26.082993 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:26.095327 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f02a5a8b-5e84-4f73-89e3-86288d5bd289 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1709 microversion: 2.1 time: 0.306907 Aug 24 04:51:26.096468 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 148/284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:25 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1709 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:26.230788 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:26.236858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c7a1fb82-affc-431b-b5a0-c408ec40af72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1299 microversion: 2.1 time: 0.297566 Aug 24 04:51:26.243011 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 137/285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:25 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1299 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:26.645914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-95b6ea86-7aa3-4723-882b-c5afb45c72cf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Action: 'create', calling method: .version_select at 0x7fb0504dee50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1170355751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJytwntJs1dzKt3Bu1EtxG1NIb/6R1lBO3eypJZVuerSAmv7tZYEJt6G/SYITFF++MQj4KcaOFQ/gq6ec7g64zisKMg+zCjsYjNFJr1o1wAv5F884SN4+suhxX5kfGJtg=="}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:26.695011 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-95b6ea86-7aa3-4723-882b-c5afb45c72cf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Getting quotas for project 003043b046cc4646a61fe4c27af47e67. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:26.711089 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-95b6ea86-7aa3-4723-882b-c5afb45c72cf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Getting quotas for user 105c18e25e104cb6a7b100caa2a96f04 and project 003043b046cc4646a61fe4c27af47e67. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:26.736404 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:26.737187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:26.754323 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:26.754911 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:26.755398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:26.756208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:26.756659 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:26.757078 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:26.772685 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-95b6ea86-7aa3-4723-882b-c5afb45c72cf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.444846 Aug 24 04:51:26.781191 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 149/286] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:51:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:27.128541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:27.129974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:27.146738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:27.148767 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:27.153580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:27.154859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:27.155507 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:27.155959 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:27.321001 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:27.343879 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:27.346563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:27.348986 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0ac56634-2716-42ab-b8dc-ea3d74605238 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.618096 Aug 24 04:51:27.350206 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 138/287] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:26 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:51:27.367177 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:27.368793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:27.380299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:27.384144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:27.391579 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:27.402430 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:27.403158 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:27.403700 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:27.610110 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:27.646800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0bdb5a56-5d69-4d0a-956f-734fc222b20a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1299 microversion: 2.1 time: 0.287503 Aug 24 04:51:27.651843 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 139/288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:27 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1299 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:27.671416 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:27.688145 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ef9a60cc-a37f-480c-a839-b087fed17367 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1709 microversion: 2.1 time: 0.566382 Aug 24 04:51:27.689416 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 150/289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:27 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1709 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:28.397081 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:28.399790 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:28.423139 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:28.424561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:28.425654 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:28.427265 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:28.428478 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:28.429809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:28.692809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:28.699495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:28.727324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:28.731065 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:28.735024 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:28.739378 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:28.742869 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:28.747181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:29.034153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:29.074837 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b08dcbe4-7e9d-4e30-b26f-e8d3e711a9f3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1299 microversion: 2.1 time: 0.389678 Aug 24 04:51:29.079350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 151/290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:28 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1299 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:29.107896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:29.109848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:29.125952 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:29.126912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:29.127520 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:29.129051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:29.129051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:29.129578 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:29.472375 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:29.488907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:29.495740 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:29.499206 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-62f69584-ca9e-464b-a2b3-81bccae70aa9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 1.108756 Aug 24 04:51:29.505224 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 140/291] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:28 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:30.125791 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:30.133696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:30.154836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:30.155527 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:30.156282 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:30.157499 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:30.158271 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:30.158962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:30.299061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:30.337575 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-81df4669-92e2-4f83-8a91-e90e1a3dbe0d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1709 microversion: 2.1 time: 1.255760 Aug 24 04:51:30.339676 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 152/292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:29 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1709 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:30.506625 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:30.521362 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2d2e9ba5-0201-496c-848d-6d5195a7e86e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1299 microversion: 2.1 time: 0.402793 Aug 24 04:51:30.524777 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 141/293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:30 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1299 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:30.553345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:30.554406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:30.569019 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:30.572072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:30.574669 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:30.576512 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:30.579166 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:30.580324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:31.339263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:31.349219 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:31.351558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:31.356608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-82f7190f-ba67-48e2-a704-463b7e4239e7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.813064 Aug 24 04:51:31.370296 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 153/294] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:30 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:51:31.379695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:31.380703 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:31.410798 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:31.411939 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:31.414047 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:31.416661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:31.417465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:31.420391 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:31.547397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:31.548291 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:31.564989 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:31.566514 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:31.574683 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:31.578141 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:31.578769 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:31.580819 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:31.637355 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:31.779358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:31.788940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-757e32af-652d-4b75-8aa6-c7490eba5362 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1299 microversion: 2.1 time: 0.245073 Aug 24 04:51:31.802527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 154/295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:31 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1299 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:31.809243 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1731684993", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49966c4c-33d7-4d8c-a6cd-288757accecd"}], "security_groups": [{"name": "tempest-securitygroup--221248486"}], "key_name": "tempest-keypair-202614937", "user_data": "}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:31.964283 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:31.979507 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4f0fc33a-8b48-4faa-a6a3-7ebc37cc981b tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1709 microversion: 2.1 time: 0.604615 Aug 24 04:51:31.980678 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 142/296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:31 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1709 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:32.072838 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.network.neutron [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] validate_networks() for [('49966c4c-33d7-4d8c-a6cd-288757accecd', None, None, None, None, None)] {{(pid=127415) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:51:32.384512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:32.385793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:32.387981 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:32.394373 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:32.394862 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:32.395483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:32.396401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:32.396854 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:32.397284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:33.198435 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:33.278552 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:33.293685 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:33.302754 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-817024b7-3557-4c87-b6d8-82715057bfdd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.918801 Aug 24 04:51:33.309000 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 143/297] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:32 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:51:33.346766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:33.353116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:33.379509 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:33.380985 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:33.383357 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:33.387699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:33.388530 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:33.389510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:33.390314 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=12 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:33.987337 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:34.001926 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2efc9dfb-3d9b-4889-9e17-409de84d2019 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.688745 Aug 24 04:51:34.003068 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 144/298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:33 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:34.004705 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Flavor limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:51:34.005224 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Image limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:51:34.005759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Flavor pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:51:34.006281 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Image pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:51:34.006880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:51:34.010543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:34.011750 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:34.018889 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:34.019674 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:34.020268 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:34.021156 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:34.021776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:34.022368 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:34.034687 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:34.035185 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:34.035629 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:34.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:34.036833 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:34.037259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:34.068754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Getting quotas for project 1a1f238eb4f34d44ac93b85181ad7001. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:34.081567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Getting quotas for user 3d5408f9ada24654839e479c7fe385ce and project 1a1f238eb4f34d44ac93b85181ad7001. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:34.104508 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Going to run 1 instances... {{(pid=127415) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:51:34.109444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:51:34.178865 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-73079abf-c150-4ed3-aae5-6ced9b8cea25 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.375135 Aug 24 04:51:34.180006 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 155/299] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:51:31 2022] POST /compute/v2.1/servers => generated 408 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:51:34.196095 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d48bdb8d-d275-41b7-a725-13c01d9716d9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:34.198811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d48bdb8d-d275-41b7-a725-13c01d9716d9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:34.379058 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d48bdb8d-d275-41b7-a725-13c01d9716d9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:34.395380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d48bdb8d-d275-41b7-a725-13c01d9716d9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1245 microversion: 2.1 time: 0.205141 Aug 24 04:51:34.395967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 156/300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:34 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1245 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:34.402388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:34.414411 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:34.433125 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:34.433650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:34.434475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:34.435406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:34.436037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:34.436628 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:34.477218 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:34.499635 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2b471366-764d-4c5c-83ff-5ef0d9450c74 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1713 microversion: 2.1 time: 0.494963 Aug 24 04:51:34.500219 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 145/301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:34 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1713 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:35.029560 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:35.044146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:35.090597 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:35.091346 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:35.092010 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:35.093237 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:35.098281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:35.099125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:35.613059 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:35.679667 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:35.689611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:35.694916 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c554aa25-1c6f-4fec-8f88-753ec38d9bd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 1.296828 Aug 24 04:51:35.697956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 157/302] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:34 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:35.745664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:35.747324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:35.776729 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:35.777844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:35.778740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:35.780644 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:35.781949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:35.783049 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:35.899008 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:35.918068 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d07c565e-6e5e-496a-9229-a108b707aa4d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.895869 Aug 24 04:51:35.921477 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 146/303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:35 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:35.942828 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:35.954836 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b3c87aa2-155b-4b7c-8fd1-f284e63fbac3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1249 microversion: 2.1 time: 0.246218 Aug 24 04:51:35.967562 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 158/304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:35 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1249 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:36.080552 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-3574d83e-8f99-46e3-a656-4ca0b2dabee9 req-da44357f-e13b-4da7-a5cb-468465195188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b427776-20b2-4c84-bf77-7049937303f6", "tag": "d5d861d6-908c-463a-b9e9-82677b7a60f7"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:36.109472 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-3574d83e-8f99-46e3-a656-4ca0b2dabee9 req-da44357f-e13b-4da7-a5cb-468465195188 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:36.110288 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-3574d83e-8f99-46e3-a656-4ca0b2dabee9 req-da44357f-e13b-4da7-a5cb-468465195188 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:36.110918 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-3574d83e-8f99-46e3-a656-4ca0b2dabee9 req-da44357f-e13b-4da7-a5cb-468465195188 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:36.128764 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-3574d83e-8f99-46e3-a656-4ca0b2dabee9 req-da44357f-e13b-4da7-a5cb-468465195188 service nova] Creating event network-changed:d5d861d6-908c-463a-b9e9-82677b7a60f7 for instance 4b427776-20b2-4c84-bf77-7049937303f6 on hv-cinder-85426 Aug 24 04:51:36.144538 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-3574d83e-8f99-46e3-a656-4ca0b2dabee9 req-da44357f-e13b-4da7-a5cb-468465195188 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068548 Aug 24 04:51:36.147308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 147/305] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:51:36.727983 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:36.729477 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:36.745127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:36.746231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:36.747112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:36.748091 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:36.748816 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:36.749883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:36.949087 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:36.950025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:36.991809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:36.992860 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:36.993530 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:36.997897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:36.998832 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:37.002045 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:37.036168 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:37.041412 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:37.045825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:37.047761 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:37.048720 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-be2c9707-46b9-4834-ad72-457ead144e1d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.325301 Aug 24 04:51:37.065652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 159/306] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:36 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:51:37.071066 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:37.072467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:37.080054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:37.090527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:37.092248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:37.093229 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:37.098316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:37.102135 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:37.227044 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:37.241900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-15df39f6-25c1-4041-a61f-7e1cc198cf07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1249 microversion: 2.1 time: 0.174695 Aug 24 04:51:37.242776 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 160/307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:37 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1249 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:37.321054 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:37.354496 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-53c5a6d6-0d30-4291-aa37-ef657bba47f2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.411064 Aug 24 04:51:37.366271 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 148/308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:36 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:38.073382 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:38.074227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:38.085363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:38.085964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:38.086495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:38.087329 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:38.088188 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:38.088895 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:38.269575 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:38.270226 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:38.280528 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:38.282329 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:38.283501 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:38.284470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:38.284946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:38.285408 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:38.307172 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:38.332479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:38.336119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:38.338398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9466fd9e-2b6d-4e6b-90e3-3e8989ad5470 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.268674 Aug 24 04:51:38.341041 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 161/309] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:38 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:38.378901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:38.380009 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:38.394907 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:38.396186 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:38.396803 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:38.402371 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:38.402999 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:38.408367 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:38.409327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:38.435329 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2d93465a-c224-463b-9b77-45e9a55f989f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1249 microversion: 2.1 time: 0.171401 Aug 24 04:51:38.447660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 149/310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:38 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1249 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:38.726071 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:38.763821 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-072de8a5-ee61-49db-95d7-0e7d7598bbf0 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.390530 Aug 24 04:51:38.765306 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 162/311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:38 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:39.368062 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:39.372566 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:39.391146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:39.391646 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:39.392097 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:39.399872 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:39.403093 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:39.403692 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:39.475003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:39.475642 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:39.498144 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:39.499436 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:39.500224 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:39.501927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:39.503873 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:39.508591 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:39.643463 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:39.661504 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d1b68c4a-1a06-4b67-ba92-75a1d0b66453 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1241 microversion: 2.1 time: 0.190516 Aug 24 04:51:39.662948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 163/312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:39 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1241 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:39.703952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:39.717157 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:39.719002 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:39.720464 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c9a6613d-4ee0-428f-aa74-2b2f6b8c0400 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.359989 Aug 24 04:51:39.734592 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 150/313] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:39 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:39.789358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:39.790332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:39.799844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:39.801833 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:39.802493 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:39.803485 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:39.803960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:39.804385 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:40.562051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:40.571063 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d24ec48a-a1d4-4f5e-8a0d-40aa8bd86d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.788342 Aug 24 04:51:40.583509 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 164/314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:39 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:40.716570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:40.719049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:40.741612 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:40.745761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:40.746698 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:40.747829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:40.748525 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:40.749164 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:40.749991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:40.751892 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:40.792483 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:40.799425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:40.800326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:40.801238 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:40.812213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:40.816854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.221780 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:41.246234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2f14dc3f-35a8-4e2d-9276-d2052a6768ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1305 microversion: 2.1 time: 0.553145 Aug 24 04:51:41.264448 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 151/315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:40 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1305 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:41.402856 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:41.420637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:41.427118 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:41.428451 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f02c81f0-770a-42c1-9cf0-b26a0e763e8a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1746 microversion: 2.20 time: 0.687389 Aug 24 04:51:41.429035 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 165/316] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:40 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1746 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:41.599694 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:41.600771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:41.626740 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.627592 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.630783 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.631712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.635394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.638971 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.070628 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:42.095789 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5ea41d0f-c078-415e-bd26-294bbb6644a2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.505642 Aug 24 04:51:42.096398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 152/317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:41 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:42.303899 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:42.305289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:42.312211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:42.314631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.315690 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.316280 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.317527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.318231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.318873 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.420699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:42.430278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-69977189-3a38-4948-ae14-ff1de4d8465b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1303 microversion: 2.1 time: 0.130893 Aug 24 04:51:42.447052 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 166/318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:42 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:42.473462 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:42.474938 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:42.496963 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.500223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.505299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.507581 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.509550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.510485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.809474 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:42.856853 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:42.860069 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:42.862211 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7b288ba3-2495-466c-90c1-87b0dba48c08 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1746 microversion: 2.20 time: 0.393722 Aug 24 04:51:42.883363 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 153/319] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:42 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1746 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:42.959274 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-9783f386-34ad-489d-8fbf-4d6e3ac46553 req-113c68bd-dd5a-4931-a77c-a29dceb0284f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eeaea49-9c15-4e0a-a446-98d3191293c8", "name": "network-vif-plugged", "status": "completed", "tag": "6bd895e9-3f00-4d89-aab3-7b4bbc97e62d"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:42.971178 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-9783f386-34ad-489d-8fbf-4d6e3ac46553 req-113c68bd-dd5a-4931-a77c-a29dceb0284f service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.971964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-9783f386-34ad-489d-8fbf-4d6e3ac46553 req-113c68bd-dd5a-4931-a77c-a29dceb0284f service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.972568 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-9783f386-34ad-489d-8fbf-4d6e3ac46553 req-113c68bd-dd5a-4931-a77c-a29dceb0284f service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.989934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-9783f386-34ad-489d-8fbf-4d6e3ac46553 req-113c68bd-dd5a-4931-a77c-a29dceb0284f service nova] Creating event network-vif-plugged:6bd895e9-3f00-4d89-aab3-7b4bbc97e62d for instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 on hv-cinder-85426 Aug 24 04:51:43.000015 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-9783f386-34ad-489d-8fbf-4d6e3ac46553 req-113c68bd-dd5a-4931-a77c-a29dceb0284f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044379 Aug 24 04:51:43.002061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 167/320] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:51:43.117197 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:43.120892 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:43.132985 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:43.139097 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:43.140199 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:43.141500 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:43.142281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:43.142983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:43.388527 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:43.401496 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3d7f29f3-57f6-47df-ad09-4893ac430abd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.288109 Aug 24 04:51:43.402734 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 154/321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:43 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:43.468856 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:43.470299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:43.517494 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:43.518408 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:43.519217 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:43.520554 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:43.521426 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:43.522238 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:43.911846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:43.913705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:43.940298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:43.942876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:43.947460 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:43.950230 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:43.951483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:43.952713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:43.953422 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:43.954884 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9b25a6ff-ea17-4685-8201-a8779274fb33 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.499440 Aug 24 04:51:43.955937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:43.969675 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 168/322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:43 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:44.261223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:44.280885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:44.284443 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:44.287195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-cdf2261f-1ebe-4083-8b54-5436dba3aefe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1746 microversion: 2.20 time: 0.392520 Aug 24 04:51:44.288700 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 155/323] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:43 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1746 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:44.426668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:44.427506 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:44.433297 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:44.435730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=12 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:44.452359 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:44.455944 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:44.457567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:44.458974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:44.459466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:44.459934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:44.710545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:44.717735 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:44.739787 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:44.769624 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:44.780249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:44.782192 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:44.790852 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:44.794258 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:44.898418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:44.914610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b1275afc-dd43-478f-9cc3-c48fc05227d1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.492527 Aug 24 04:51:44.916900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 169/324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:44 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:45.006959 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:45.007960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:45.019359 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.020300 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.020910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:45.021905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.022853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.023457 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:45.233217 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lazy-loading 'services' on Instance uuid 35023e55-459b-4d6f-be1d-cdd01a5b318c {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:51:45.391416 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:45.406138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d111c829-8390-4a7f-83d9-16888fa23684 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.402607 Aug 24 04:51:45.408049 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 170/325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:45 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:45.417396 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-68de2672-41b2-4f16-9c5d-c0e58795a724 req-fc7e1c4f-2583-4900-bd88-df68c55552f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15409608-f562-4e3c-af4c-e918e3f5921b", "tag": "3275601c-1146-4292-877e-cda074b8821f"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:45.438175 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-68de2672-41b2-4f16-9c5d-c0e58795a724 req-fc7e1c4f-2583-4900-bd88-df68c55552f0 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.439468 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-68de2672-41b2-4f16-9c5d-c0e58795a724 req-fc7e1c4f-2583-4900-bd88-df68c55552f0 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.440277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-68de2672-41b2-4f16-9c5d-c0e58795a724 req-fc7e1c4f-2583-4900-bd88-df68c55552f0 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:45.473741 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-68de2672-41b2-4f16-9c5d-c0e58795a724 req-fc7e1c4f-2583-4900-bd88-df68c55552f0 service nova] Creating event network-changed:3275601c-1146-4292-877e-cda074b8821f for instance 15409608-f562-4e3c-af4c-e918e3f5921b on hv-cinder-85426 Aug 24 04:51:45.485911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-68de2672-41b2-4f16-9c5d-c0e58795a724 req-fc7e1c4f-2583-4900-bd88-df68c55552f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075146 Aug 24 04:51:45.487249 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 171/326] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:45.497516 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:45.499230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:45.512365 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.513487 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.514466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:45.515902 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.527376 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.528655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:45.585205 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a719bdd8-24b6-4e1f-8a09-0907947e469f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c/os-volume_attachments/8ad8e65a-eff2-40c4-b8cf-67da8747fd20" status: 202 len: 0 microversion: 2.1 time: 0.883185 Aug 24 04:51:45.586857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 156/327] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:51:44 2022] DELETE /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c/os-volume_attachments/8ad8e65a-eff2-40c4-b8cf-67da8747fd20 => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:51:45.860207 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:45.877633 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:45.885887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:45.887777 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e488535a-533e-4356-a712-71e1d8903503 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.398544 Aug 24 04:51:45.893418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 172/328] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:45 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:45.944797 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:45.945898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:45.958316 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.959164 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.959966 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:45.960876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.961653 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.962390 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:46.221053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:46.245517 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-14a4dbd6-3dba-489b-9b04-fed918b42d45 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.305389 Aug 24 04:51:46.270871 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 157/329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:45 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:46.436250 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:46.437084 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:46.465948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:46.467202 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:46.468486 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:46.469553 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:46.470391 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:46.471182 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:46.919766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:46.920702 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:46.939214 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:46.951649 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:46.953447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:46.961611 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:46.965766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:46.968134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:46.983285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:47.033796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b83761b5-bfc7-41ba-86f1-ad768d2b8da6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.601139 Aug 24 04:51:47.042114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 173/330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:46 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:47.303050 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:47.306975 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:47.330390 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:47.331551 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:47.333368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:47.335563 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:47.337778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:47.339679 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:47.351470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:47.424489 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:47.465137 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:47.470589 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:47.475446 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5093d1a0-6715-4814-9416-64f5bf3c48a4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.560707 Aug 24 04:51:47.504879 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 158/331] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:46 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:51:47.729480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:47.749240 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0ca48492-60b3-4e8b-8945-e3a126032329 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.468297 Aug 24 04:51:47.751066 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 174/332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:47 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:48.076894 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:48.080383 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:48.117816 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.132953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.133631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:48.135041 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.135725 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:48.136771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.138705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.140297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.150502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.152422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.153914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.156004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.157143 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.158140 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.287363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:51:48.460832 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:48.497099 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5dda9ef1-e321-4e26-9106-2d53693e5a9e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.430341 Aug 24 04:51:48.503038 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 159/333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:48 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:48.558844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-03856267-fc10-46cc-8bf3-ef37fff17061 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 204 len: 0 microversion: 2.1 time: 0.432243 Aug 24 04:51:48.560286 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:48.561001 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:48.564992 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 175/334] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:51:48 2022] DELETE /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:51:48.573716 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.575645 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.576920 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.577917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.578610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.579347 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.588401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:48.589139 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:48.614140 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.614644 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.615090 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.615866 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.620969 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.622093 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.942838 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:48.957500 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:48.959743 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:48.965397 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-db7ce771-1285-4622-a1c6-56ab6021c42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.447270 Aug 24 04:51:48.965989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 160/335] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:48 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:51:48.972517 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:48.974873 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:48.992051 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.992550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.992991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.993817 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:48.994305 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:48.994725 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:48.997044 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:49.023532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a6e0317b-9a70-40ce-9937-282303b1a349 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1513 microversion: 2.1 time: 0.448198 Aug 24 04:51:49.025188 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 176/336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:48 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:49.217493 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:49.228463 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-34e0b9a7-f65e-4928-a72d-b7ec4b7c2813 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.259809 Aug 24 04:51:49.229837 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 161/337] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:48 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:49.535719 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:49.536348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:49.553065 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:49.553951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:49.554960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:49.556351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:49.557230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:49.558034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:49.792698 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-74b2ca5d-e557-4b4e-93f0-1feaa24e7134 req-397193db-5739-4d46-a575-44a13dced7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b427776-20b2-4c84-bf77-7049937303f6", "name": "network-vif-plugged", "status": "completed", "tag": "d5d861d6-908c-463a-b9e9-82677b7a60f7"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:49.803142 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:49.814299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7db2e6d3-292c-427b-99dc-ed09fcc9a5fc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.282513 Aug 24 04:51:49.815557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 177/338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:49 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:49.834574 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-74b2ca5d-e557-4b4e-93f0-1feaa24e7134 req-397193db-5739-4d46-a575-44a13dced7ed service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:49.848641 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-74b2ca5d-e557-4b4e-93f0-1feaa24e7134 req-397193db-5739-4d46-a575-44a13dced7ed service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:49.849411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-74b2ca5d-e557-4b4e-93f0-1feaa24e7134 req-397193db-5739-4d46-a575-44a13dced7ed service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:49.895112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-74b2ca5d-e557-4b4e-93f0-1feaa24e7134 req-397193db-5739-4d46-a575-44a13dced7ed service nova] Creating event network-vif-plugged:d5d861d6-908c-463a-b9e9-82677b7a60f7 for instance 4b427776-20b2-4c84-bf77-7049937303f6 on hv-cinder-85426 Aug 24 04:51:49.914677 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-74b2ca5d-e557-4b4e-93f0-1feaa24e7134 req-397193db-5739-4d46-a575-44a13dced7ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130186 Aug 24 04:51:49.918187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 162/339] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:50.005402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:50.007351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:50.024792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:50.027882 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:50.027882 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:50.028495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:50.029302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:50.030729 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:50.056911 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:50.064901 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:50.083042 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:50.083916 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:50.085079 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:50.086650 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:50.088484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:50.089420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:50.468102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:50.488362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:50.492788 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0e8d8d19-0967-4405-a0b2-37b47e6cbc95 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1513 microversion: 2.1 time: 0.446397 Aug 24 04:51:50.509634 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 163/340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:50 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:50.519075 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:50.522691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:50.524100 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ba3d9ab2-f5b0-4f74-9c68-7bec96c04c90 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.534660 Aug 24 04:51:50.542055 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 178/341] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:49 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:51:50.572647 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:50.574368 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:50.610112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:50.611168 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:50.619927 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:50.621698 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:50.624377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:50.630243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:50.843625 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:50.844401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:50.857468 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:50.862956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:50.864721 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:50.866267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:50.868759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:50.874512 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:51.050171 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:51.060546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b2f30d1c-3a96-4ce6-92ba-9897d6c9de3c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.531500 Aug 24 04:51:51.062637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 164/342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:50 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:51.244806 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:51.286286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-10603ed6-4e85-42c7-945d-bf7faed95bcc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.449975 Aug 24 04:51:51.295525 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 179/343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:50 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:51.544397 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:51.545847 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:51.559538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:51.560631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:51.564523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:51.566548 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:51.567196 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:51.572161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:51.574845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:51.575546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:51.579071 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:51.599752 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:51.600613 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:51.601363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:51.603244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:51.604173 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:51.605675 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:52.325663 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:52.346978 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7f2fe595-17f2-45ef-b2ab-4ea7b467b937 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1513 microversion: 2.1 time: 0.827092 Aug 24 04:51:52.358514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 165/344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:51 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1513 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:52.372867 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-835549605", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:52.449892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:52.495065 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:52.510718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:52.513477 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-56460218-8b64-43ce-b4b5-9a8141ab240e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.963049 Aug 24 04:51:52.530783 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 180/345] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:51 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:52.569388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:52.570605 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:52.593959 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:52.594979 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:52.595921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:52.597488 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:52.599661 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:52.600850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:53.074258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:53.088656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a909f41c-0567-4086-892a-f360e1fc890d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1367 microversion: 2.1 time: 0.554498 Aug 24 04:51:53.105602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 181/346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:52 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:53.114335 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:53.115481 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:53.124379 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:53.127807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:53.128371 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:53.129414 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:53.130073 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:53.130682 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:53.453453 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:53.467694 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5830f5b1-7b18-42b2-995c-2e15e1a91943 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.357011 Aug 24 04:51:53.468673 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 182/347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:53 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:53.495559 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-7dcda5b0-41a1-4279-8e01-4a9c834536bc req-07780f8c-e69e-4ae4-addc-267b709e50d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35023e55-459b-4d6f-be1d-cdd01a5b318c", "name": "network-vif-deleted", "tag": "dfb279cf-9929-4520-adae-43f66b8885aa"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:53.520086 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-7dcda5b0-41a1-4279-8e01-4a9c834536bc req-07780f8c-e69e-4ae4-addc-267b709e50d2 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:53.520883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-7dcda5b0-41a1-4279-8e01-4a9c834536bc req-07780f8c-e69e-4ae4-addc-267b709e50d2 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:53.521576 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-7dcda5b0-41a1-4279-8e01-4a9c834536bc req-07780f8c-e69e-4ae4-addc-267b709e50d2 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:53.539628 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-7dcda5b0-41a1-4279-8e01-4a9c834536bc req-07780f8c-e69e-4ae4-addc-267b709e50d2 service nova] Creating event network-vif-deleted:dfb279cf-9929-4520-adae-43f66b8885aa for instance 35023e55-459b-4d6f-be1d-cdd01a5b318c on hv-cinder-85426 Aug 24 04:51:53.551332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-7dcda5b0-41a1-4279-8e01-4a9c834536bc req-07780f8c-e69e-4ae4-addc-267b709e50d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065866 Aug 24 04:51:53.552366 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 183/348] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:53.561794 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:53.563105 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:53.571491 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:53.572570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:53.573453 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:53.574534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:53.575277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:53.576099 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:53.626328 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:53.627162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:53.627932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:53.628715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lazy-loading 'fault' on Instance uuid 35023e55-459b-4d6f-be1d-cdd01a5b318c {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:51:53.685942 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:53.698282 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5440887d-47f7-46b5-b3ee-b26f01d63c13 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 200 len: 1308 microversion: 2.1 time: 0.144043 Aug 24 04:51:53.699638 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 184/349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:53 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:53.706127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-673422413", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1170355751", "security_groups": [{"name": "tempest-secgroup-smoke-1341339893"}], "block_device_mapping_v2": [{"uuid": "29814043-82ef-4d00-a595-a6f6ac39a090", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e2fdcab-491d-4305-ac60-290a289ebd7f"}]}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:53.869712 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.network.neutron [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] validate_networks() for [('2e2fdcab-491d-4305-ac60-290a289ebd7f', None, None, None, None, None)] {{(pid=127415) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:51:54.409375 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] validate_networks() for None {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:51:55.037707 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Flavor limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:51:55.038536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Image limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:51:55.038655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Flavor pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:51:55.039001 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Image pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:51:55.039410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:51:55.064437 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:55.064937 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:55.066415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:55.067918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:55.068599 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:55.069198 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:55.101054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Getting quotas for project 003043b046cc4646a61fe4c27af47e67. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:55.109169 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Getting quotas for user 105c18e25e104cb6a7b100caa2a96f04 and project 003043b046cc4646a61fe4c27af47e67. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:55.202171 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:51:55.203020 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:51:55.203799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:51:55.204324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:51:55.204980 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:51:55.216169 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Going to run 1 instances... {{(pid=127415) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:51:55.218265 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:55.219169 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:55.219680 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:55.219827 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29814043-82ef-4d00-a595-a6f6ac39a090',volume_size=None,volume_type=None)] {{(pid=127415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:51:55.220617 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:55.221220 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:55.222589 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:55.253819 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Getting quotas for project dd04d25b96334e8982b71c0a5c1ee50b. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:55.260673 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Getting quotas for user 02367d75d65646f595823dbea8ab8221 and project dd04d25b96334e8982b71c0a5c1ee50b. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:55.277546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:51:55.280181 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:51:55.347614 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-869a20dd-a64a-4ee7-bcfd-bf3b7c09eb53 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.987535 Aug 24 04:51:55.348275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 166/350] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:51:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:51:55.354102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:55.355171 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:55.363943 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:55.365433 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:55.366322 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:55.372258 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:55.373603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:55.374726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:55.585766 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2b9d4e28-ec02-4c1c-8581-a80a3add34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.884510 Aug 24 04:51:55.588513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 185/351] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:51:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:51:55.631377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:55.632611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:55.636164 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:55.645051 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:55.652065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:55.662976 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b720f490-7d43-4f6c-813f-aa0fabdc52dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.304732 Aug 24 04:51:55.664544 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 167/352] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:55 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:55.667495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:55.668664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:55.669295 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:55.670425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:55.670987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:55.671638 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:55.682967 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-ffb74094-e8ef-4a46-956e-f17084cc98da req-53fcba06-3d6e-4ef1-99c2-52f45863de70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15409608-f562-4e3c-af4c-e918e3f5921b", "name": "network-vif-plugged", "status": "completed", "tag": "3275601c-1146-4292-877e-cda074b8821f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:55.716256 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-ffb74094-e8ef-4a46-956e-f17084cc98da req-53fcba06-3d6e-4ef1-99c2-52f45863de70 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:55.717242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-ffb74094-e8ef-4a46-956e-f17084cc98da req-53fcba06-3d6e-4ef1-99c2-52f45863de70 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:55.717908 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-ffb74094-e8ef-4a46-956e-f17084cc98da req-53fcba06-3d6e-4ef1-99c2-52f45863de70 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:55.765780 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-ffb74094-e8ef-4a46-956e-f17084cc98da req-53fcba06-3d6e-4ef1-99c2-52f45863de70 service nova] Creating event network-vif-plugged:3275601c-1146-4292-877e-cda074b8821f for instance 15409608-f562-4e3c-af4c-e918e3f5921b on hv-cinder-85426 Aug 24 04:51:55.784177 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-ffb74094-e8ef-4a46-956e-f17084cc98da req-53fcba06-3d6e-4ef1-99c2-52f45863de70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116593 Aug 24 04:51:55.786347 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 168/353] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:55.800846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e51db1f2-21c0-417f-8d7b-7cbcd4c94aa7 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Action: 'create', calling method: .version_select at 0x7fb050b38310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-658819250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmanhnshTmCuhnySU1kqQsscnKyG1w2deXlI0s2aZAyuuUDIWrW+rn3OUBFD/5O2M3cWd8aWRkAclbM31cW5bg74FXbUHnBN3X4qM1EYRnNRydLxF9YHT2IcSeb5KHcTw=="}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:55.876275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-e51db1f2-21c0-417f-8d7b-7cbcd4c94aa7 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Getting quotas for project 09a4b40ff55a4b4095912e0e58cbc374. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:55.892615 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-e51db1f2-21c0-417f-8d7b-7cbcd4c94aa7 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Getting quotas for user 14f695d39b654b7da7ee6d7aa0a8a7b3 and project 09a4b40ff55a4b4095912e0e58cbc374. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:55.973108 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e51db1f2-21c0-417f-8d7b-7cbcd4c94aa7 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.184017 Aug 24 04:51:55.985018 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 169/354] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:51:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:55.985543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:55.986757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:56.000502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:56.002349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:56.004504 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:56.006416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:56.007834 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:56.010772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:56.082528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:56.096798 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a3e82fb4-e80d-4eab-9dec-955170c44ae4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1557 microversion: 2.1 time: 0.494821 Aug 24 04:51:56.115499 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 186/355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:55 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1557 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:56.140079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:56.143554 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 35023e55-459b-4d6f-be1d-cdd01a5b318c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:56.159546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:56.169891 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:56.171101 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:56.173382 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:56.177296 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:56.183658 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:56.262106 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] HTTP exception thrown: Instance 35023e55-459b-4d6f-be1d-cdd01a5b318c could not be found. Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Request method failure captured: Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c HTTP/1.1 Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa4TBS5G4gYp8-NxyoZf68ybNJ31WRoDyOrt128M0rRJBBU4hufh5lfL0iovgju8bCDBZy-9uFw83DrsHkeLcobf7Ah78lPc4BbjIjBV_gRl4NbZJ5BSjY7-vfbtKo_7M75KNnBUWCnrH5PUblofKJYE23jqBej8Z3Zm8ogXhsgX2go Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: f99e1a77e4404c48b4cfdc745668a496 Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2126527978 Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:51:56.269515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f99e1a77e4404c48b4cfdc745668a496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f99e1a77e4404c48b4cfdc745668a496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f99e1a77e4404c48b4cfdc745668a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f99e1a77e4404c48b4cfdc745668a496"}]}] Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesSnapshotTestJSON-2126527978 Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: f99e1a77e4404c48b4cfdc745668a496 Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2126527978 Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesSnapshotTestJSON-2126527978-project Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: f652b0da0bf841dab4d3ed6e9e9c1f88 Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesSnapshotTestJSON-2126527978-project Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 35023e55-459b-4d6f-be1d-cdd01a5b318c could not be found. Aug 24 04:51:56.271692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '35023e55-459b-4d6f-be1d-cdd01a5b318c'} Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35023e55-459b-4d6f-be1d-cdd01a5b318c could not be found. Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:51:56.273377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35023e55-459b-4d6f-be1d-cdd01a5b318c could not be found. Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35023e55-459b-4d6f-be1d-cdd01a5b318c could not be found. Aug 24 04:51:56.279081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:51:56.286906 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Returning 404 to user: Instance 35023e55-459b-4d6f-be1d-cdd01a5b318c could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:51:56.292337 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0d85a53e-c2dc-4df4-863c-95849860bfb0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c" status: 404 len: 111 microversion: 2.1 time: 0.171802 Aug 24 04:51:56.298422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 187/356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:56 2022] GET /compute/v2.1/servers/35023e55-459b-4d6f-be1d-cdd01a5b318c => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:51:56.316034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ea3689e0-68da-4691-a294-e0370cbb53d9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:56.317364 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ea3689e0-68da-4691-a294-e0370cbb53d9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:56.689287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ea3689e0-68da-4691-a294-e0370cbb53d9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:56.703320 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ea3689e0-68da-4691-a294-e0370cbb53d9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1214 microversion: 2.1 time: 0.402772 Aug 24 04:51:56.705415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 188/357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:56 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1214 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:56.733507 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6743c865-fe7f-4870-9818-5b7c483b366e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:56.734950 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6743c865-fe7f-4870-9818-5b7c483b366e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:56.775580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:56.794253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c6ebcee2-5a8c-49ed-89b4-be6209101f12 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.818692 Aug 24 04:51:56.799960 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 170/358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:55 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:56.813929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-aa19aafd-16d3-4d16-855e-b4204749735d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:56.821058 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-aa19aafd-16d3-4d16-855e-b4204749735d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:56.830267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa19aafd-16d3-4d16-855e-b4204749735d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:56.830997 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa19aafd-16d3-4d16-855e-b4204749735d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:56.831444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa19aafd-16d3-4d16-855e-b4204749735d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:56.832183 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa19aafd-16d3-4d16-855e-b4204749735d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:56.832646 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa19aafd-16d3-4d16-855e-b4204749735d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:56.833079 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa19aafd-16d3-4d16-855e-b4204749735d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:56.907226 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6743c865-fe7f-4870-9818-5b7c483b366e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:56.919913 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6743c865-fe7f-4870-9818-5b7c483b366e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1094 microversion: 2.1 time: 0.195782 Aug 24 04:51:56.934374 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 189/359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:56 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1094 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:56.940324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-806586356", "imageRef": "2506e67d-45a7-4700-9c4f-20b744fd004b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-658819250", "networks": [{"uuid": "5f034185-acc9-4295-86c9-7eee0983302b"}]}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:57.046427 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-aa19aafd-16d3-4d16-855e-b4204749735d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.234934 Aug 24 04:51:57.046427 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 171/360] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 24 04:51:56 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:57.054996 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:57.056664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:57.067102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:57.068289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:57.068829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:57.069671 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:57.070263 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:57.070796 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:57.167239 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.network.neutron [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] validate_networks() for [('5f034185-acc9-4295-86c9-7eee0983302b', None, None, None, None, None)] {{(pid=127415) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:51:57.465090 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:57.487011 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:57.488581 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:57.492825 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-93e11e5b-0cfc-4b8b-8142-04bcee4ac6dd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.450148 Aug 24 04:51:57.495092 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 172/361] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:57 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:51:57.732454 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:57.733322 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:57.752311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:57.752930 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:57.754350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:57.756348 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:57.756895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:57.757377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:57.900104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Flavor limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:51:57.900783 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Image limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:51:57.901351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Flavor pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:51:57.901829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Image pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:51:57.902337 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:51:57.926112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:57.930860 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:57.931580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:57.932501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:57.933061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:57.933562 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:57.990448 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:58.003932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-51f19c07-c243-4586-a056-4e958c0240d7 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1266 microversion: 2.1 time: 0.273921 Aug 24 04:51:58.005481 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Getting quotas for project 09a4b40ff55a4b4095912e0e58cbc374. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:58.006415 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 173/362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:57 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:58.016239 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:58.024354 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Getting quotas for user 14f695d39b654b7da7ee6d7aa0a8a7b3 and project 09a4b40ff55a4b4095912e0e58cbc374. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:58.025105 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:58.043914 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:58.045744 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:58.046610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:58.049368 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:58.051633 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:58.052077 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:58.061023 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Going to run 1 instances... {{(pid=127415) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:51:58.063315 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2506e67d-45a7-4700-9c4f-20b744fd004b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:51:58.123832 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8f42f4c4-aef0-448a-af99-580c95700dbd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187692 Aug 24 04:51:58.124765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 190/363] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:51:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:51:58.130303 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:58.131686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:58.141721 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:58.142682 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:58.143389 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:58.144385 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:58.145332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:58.146209 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:58.352914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:58.379259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6e9a206b-0fd2-4f1d-9543-8001a4bb00ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1136 microversion: 2.1 time: 0.252767 Aug 24 04:51:58.380306 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 191/364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:58 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1136 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:58.407181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1b593135-78c9-4f62-bee2-8727c723cd39 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:58.411404 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1b593135-78c9-4f62-bee2-8727c723cd39 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:58.475523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:58.500221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b2ae64d6-1248-4d07-b307-ffad76c29bbc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.491829 Aug 24 04:51:58.507114 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 174/365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:58 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:58.534225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:58.535924 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:58.545644 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:58.547299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:58.551506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:58.554833 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:58.556921 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:58.558105 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1b593135-78c9-4f62-bee2-8727c723cd39 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:58.562996 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:58.577593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1b593135-78c9-4f62-bee2-8727c723cd39 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1257 microversion: 2.1 time: 0.186238 Aug 24 04:51:58.580840 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 192/366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:58 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1257 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:58.791427 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-23307ed7-cdf9-4e17-b6af-7ae30e8aeeb7 req-32e9018a-40d1-42ac-ac44-9a3b8688c2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b427776-20b2-4c84-bf77-7049937303f6", "tag": "d5d861d6-908c-463a-b9e9-82677b7a60f7"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:58.822825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:58.831943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-23307ed7-cdf9-4e17-b6af-7ae30e8aeeb7 req-32e9018a-40d1-42ac-ac44-9a3b8688c2ec service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:58.839110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-23307ed7-cdf9-4e17-b6af-7ae30e8aeeb7 req-32e9018a-40d1-42ac-ac44-9a3b8688c2ec service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:58.840327 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-23307ed7-cdf9-4e17-b6af-7ae30e8aeeb7 req-32e9018a-40d1-42ac-ac44-9a3b8688c2ec service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:58.874734 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-23307ed7-cdf9-4e17-b6af-7ae30e8aeeb7 req-32e9018a-40d1-42ac-ac44-9a3b8688c2ec service nova] Creating event network-changed:d5d861d6-908c-463a-b9e9-82677b7a60f7 for instance 4b427776-20b2-4c84-bf77-7049937303f6 on hv-cinder-85426 Aug 24 04:51:58.906400 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-23307ed7-cdf9-4e17-b6af-7ae30e8aeeb7 req-32e9018a-40d1-42ac-ac44-9a3b8688c2ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122261 Aug 24 04:51:58.910626 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 193/367] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:51:58.976619 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:58.989996 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:58.996146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:59.001229 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-6b0a9500-3653-4abb-a636-62694f8841ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.470895 Aug 24 04:51:59.014530 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 175/368] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:51:58 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:51:59.040664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:59.041662 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:59.054582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:59.055030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:59.056317 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:59.059798 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:59.060983 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:59.061464 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:59.166194 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:59.175660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-366d7b6a-4cde-41a2-be85-b4350045539e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1266 microversion: 2.1 time: 0.141951 Aug 24 04:51:59.176682 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 194/369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:59 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:59.412564 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:59.414483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:59.427826 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:59.429262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:59.431734 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:59.433693 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:59.434937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:59.436081 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:59.550584 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:59.558128 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:59.563595 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:59.583484 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:59.584343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:59.585589 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9de6f98a-3eb5-4031-90e6-46b41d6fbd38 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1136 microversion: 2.1 time: 0.172892 Aug 24 04:51:59.599678 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 176/370] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:59 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1136 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:59.599900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:59.599900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:59.599900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:59.599900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:59.604318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:59.615632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:59.616789 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:59.654890 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:59.656010 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:59.656506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:59.657784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:59.658663 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:59.659254 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:59.859413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:59.873786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b3a2c3f8-2f2e-4ef7-8000-2bf32ed1685b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1261 microversion: 2.1 time: 0.265926 Aug 24 04:51:59.876788 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 177/371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:59 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1261 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:00.005693 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:00.021160 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8d003772-a8fe-4733-86cf-d68af5fbefe7 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.484667 Aug 24 04:52:00.022345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 195/372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:59 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:00.048680 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:00.050116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:00.065289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:00.066170 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:00.066876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:00.067887 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:00.068678 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:00.069491 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:00.207834 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:00.208556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:00.226216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:00.227029 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:00.228243 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:00.229312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:00.229974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:00.230614 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:00.402682 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:00.425982 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-806a858f-a638-4e4b-b7e0-861bd0a7a6a5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1266 microversion: 2.1 time: 0.230020 Aug 24 04:52:00.443196 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 196/373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:00 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:00.457324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:00.470371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:00.474921 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:00.476800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3cafb625-b62f-4402-8324-6e0e045a2631 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.439504 Aug 24 04:52:00.477930 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 178/374] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:00 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:00.615026 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:00.616765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:00.639142 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:00.639657 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:00.640135 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:00.641009 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:00.641535 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:00.641969 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:00.798074 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:00.808091 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-dd73ef59-5e46-4a06-8fac-4e424126c77d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1192 microversion: 2.1 time: 0.200711 Aug 24 04:52:00.809620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 197/375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:00 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1192 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:00.907838 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:00.908553 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:00.935767 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:00.936667 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:00.937448 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:00.938965 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:00.939661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:00.940927 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:01.026045 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:01.036688 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d58fa1d7-13b0-4a6e-b1c9-bc8a131f9740 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1253 microversion: 2.1 time: 0.135294 Aug 24 04:52:01.053695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 179/376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:00 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1253 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:01.076017 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:01.084559 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:01.110700 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:01.111796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:01.113850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:01.115527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:01.117416 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:01.118678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:01.335471 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:01.350258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3a1fb2f9-9c65-4987-91bb-9b7b0243c86f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1370 microversion: 2.1 time: 0.284579 Aug 24 04:52:01.350998 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 198/377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:01 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:01.472154 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:01.473154 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:01.483084 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:01.483682 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:01.484196 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:01.484995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:01.485524 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:01.486089 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:01.503242 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:01.503943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:01.518334 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:01.519241 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:01.520113 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:01.521350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:01.522345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:01.523639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:01.615524 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:01.648411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4693a9a3-9e6e-4132-a621-3d650afa6d0c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1274 microversion: 2.1 time: 0.167701 Aug 24 04:52:01.650326 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 180/378] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:01 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:01.841109 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:01.841714 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:01.851480 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:01.852622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:01.853150 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:01.853970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:01.854465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:01.854899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:01.880952 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:01.906829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:01.911301 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:01.913900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-722f34df-c31c-47ca-980f-7e005ba1957d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.414065 Aug 24 04:52:01.917374 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 199/379] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:01 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:01.969828 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:01.981699 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-cd1bd2da-1e27-4eff-aabf-a0c485b96aa6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1192 microversion: 2.1 time: 0.151039 Aug 24 04:52:01.982484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 181/380] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:01 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1192 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:02.062949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:02.063429 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:02.070257 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.070782 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.071882 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:02.072663 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.073130 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.073560 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:02.151164 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:02.160815 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-95a726ad-f295-4d14-a8bc-a048fc6d282c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1309 microversion: 2.1 time: 0.102521 Aug 24 04:52:02.161445 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 200/381] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:02 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:02.375669 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:02.377021 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:02.383599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.384587 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.385314 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:02.386311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.386992 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.387648 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:02.592679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:02.607371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a4d84ab4-d6c8-4852-b565-c313ff871526 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1564 microversion: 2.1 time: 0.236236 Aug 24 04:52:02.608441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 182/382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:02 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1564 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:02.631259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2c999a66-18d7-48d0-b8d7-5755e75c58c8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:02.631741 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2c999a66-18d7-48d0-b8d7-5755e75c58c8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:02.642083 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2c999a66-18d7-48d0-b8d7-5755e75c58c8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.642587 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2c999a66-18d7-48d0-b8d7-5755e75c58c8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.643030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2c999a66-18d7-48d0-b8d7-5755e75c58c8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:02.643753 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2c999a66-18d7-48d0-b8d7-5755e75c58c8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.644238 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2c999a66-18d7-48d0-b8d7-5755e75c58c8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.644958 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2c999a66-18d7-48d0-b8d7-5755e75c58c8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:02.674635 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:02.675769 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:02.686218 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.687241 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.687906 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:02.688990 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.689794 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.690781 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:02.819486 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2c999a66-18d7-48d0-b8d7-5755e75c58c8 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192298 Aug 24 04:52:02.821068 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 201/383] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 24 04:52:02 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:02.849377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:02.865718 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d5598fb1-6e82-4cfc-b5dc-48ec40840d19 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1274 microversion: 2.1 time: 0.195587 Aug 24 04:52:02.886185 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 183/384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:02 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:02.949307 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:02.950277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:02.960955 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.961776 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.962510 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:02.964047 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:02.964827 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:02.965625 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:03.015260 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:03.015893 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:03.026913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:03.030638 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:03.031503 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:03.032546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:03.033264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:03.033918 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:03.053630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=100 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:03.192040 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:03.207102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-28b4f109-b574-4b78-b706-d0c94c4c8753 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1192 microversion: 2.1 time: 0.196278 Aug 24 04:52:03.222713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 184/385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:03 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1192 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:03.228868 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:03.229978 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:03.244223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:03.244931 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:03.245719 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:03.258545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:03.259474 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:03.260539 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:03.334363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:03.354128 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:03.373607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:03.384233 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-02bab7e1-809e-46e4-b1e4-445061a828ad tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.441900 Aug 24 04:52:03.386138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 202/386] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:02 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:03.409509 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:03.421014 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-64fdc739-ecbd-404a-b9b2-37b1bde78d5a tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1309 microversion: 2.1 time: 0.196700 Aug 24 04:52:03.421906 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 185/387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:03 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:03.903714 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:03.905123 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:03.949002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:03.949866 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:03.950799 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:03.951400 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:03.952009 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:03.952795 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:04.060812 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:04.079295 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c06331ef-aacf-4510-aa82-aeaf11b15606 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1284 microversion: 2.1 time: 0.181210 Aug 24 04:52:04.080447 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 203/388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:03 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:04.234600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:04.235321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:04.254809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:04.256058 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:04.257171 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:04.259331 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:04.261032 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:04.261977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:04.413721 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:04.417832 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:04.422032 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:04.428927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:04.430345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:04.431430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:04.432968 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:04.434033 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:04.434942 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:04.436914 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-782bdedd-f1f0-4062-9b65-341e027d5d21 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1192 microversion: 2.1 time: 0.209358 Aug 24 04:52:04.451070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 186/389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:04 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1192 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:04.453358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:04.454436 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:04.469909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:04.471373 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:04.472085 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:04.473108 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:04.474323 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:04.475037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:04.675479 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:04.714436 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-09ecca73-68e5-4d15-a6b1-1a7fceda6645 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1309 microversion: 2.1 time: 0.270904 Aug 24 04:52:04.715763 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 187/390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:04 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1309 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:04.859273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:04.873901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:04.877359 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:04.890985 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1b4cef3c-32f3-4f5b-b870-3d874b9ee942 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.484637 Aug 24 04:52:04.892522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 204/391] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:04 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:05.123571 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:05.124617 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:05.136852 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:05.139808 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:05.141288 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:05.145045 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:05.145692 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:05.147497 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:05.262282 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:05.311066 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-682701954", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "networks": [{"uuid": "4abf580d-58e4-4cc5-9958-91c977dfd0da"}]}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:05.340563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:05.357369 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-12bf584a-6a06-41f5-b294-7326bfec4a16 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1272 microversion: 2.1 time: 0.239339 Aug 24 04:52:05.370585 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 188/392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:05 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:05.408795 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-e2476fe7-1813-4e5e-94f6-8b2f7a046d38 req-d011921a-6cc8-4909-a856-7ffb4a3276a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15409608-f562-4e3c-af4c-e918e3f5921b", "tag": "3275601c-1146-4292-877e-cda074b8821f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:05.434500 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-e2476fe7-1813-4e5e-94f6-8b2f7a046d38 req-d011921a-6cc8-4909-a856-7ffb4a3276a7 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:05.435156 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-e2476fe7-1813-4e5e-94f6-8b2f7a046d38 req-d011921a-6cc8-4909-a856-7ffb4a3276a7 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:05.441145 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-e2476fe7-1813-4e5e-94f6-8b2f7a046d38 req-d011921a-6cc8-4909-a856-7ffb4a3276a7 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:05.442830 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.network.neutron [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] validate_networks() for [('4abf580d-58e4-4cc5-9958-91c977dfd0da', None, None, None, None, None)] {{(pid=127415) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:52:05.501175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-e2476fe7-1813-4e5e-94f6-8b2f7a046d38 req-d011921a-6cc8-4909-a856-7ffb4a3276a7 service nova] Creating event network-changed:3275601c-1146-4292-877e-cda074b8821f for instance 15409608-f562-4e3c-af4c-e918e3f5921b on hv-cinder-85426 Aug 24 04:52:05.527667 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-e2476fe7-1813-4e5e-94f6-8b2f7a046d38 req-d011921a-6cc8-4909-a856-7ffb4a3276a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123079 Aug 24 04:52:05.532609 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 189/393] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:05.564645 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:05.572819 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:05.591675 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:05.596447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:05.597449 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:05.598489 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:05.599377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:05.601894 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:05.905629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:05.918875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e00b4d43-8fb5-45f2-8eab-7f0b21b991bb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1210 microversion: 2.1 time: 0.383022 Aug 24 04:52:05.932612 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 190/394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:05 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1210 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:05.943752 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:05.954092 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:05.954092 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=10 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:05.955283 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:05.960013 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:05.960013 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:05.960013 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:05.960013 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:05.960711 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:06.290618 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:06.314394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5e0113c0-0dde-4f0a-b828-3008e07d5ba8 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1315 microversion: 2.1 time: 0.374879 Aug 24 04:52:06.318441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 191/395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:05 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:06.341145 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:06.343002 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:06.370856 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:06.372428 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:06.373358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:06.374909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:06.380147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:06.390703 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:07.676902 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Flavor limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:52:07.678185 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Image limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:52:07.678997 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Flavor pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:52:07.679527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Image pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:52:07.680956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:52:07.714525 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:07.716232 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:07.717927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:07.719965 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:07.722615 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:07.723347 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:07.793896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:07.812825 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:07.814985 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:07.816344 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8476a3be-32c5-4bee-bcc9-b1ca3812ff62 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 1.496134 Aug 24 04:52:07.817382 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Getting quotas for project f99e1a77e4404c48b4cfdc745668a496. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:52:07.828593 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 192/396] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:06 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:07.833481 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:07.846891 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Getting quotas for user f652b0da0bf841dab4d3ed6e9e9c1f88 and project f99e1a77e4404c48b4cfdc745668a496. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:52:07.855734 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:07.862198 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:07.890513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:07.893032 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:07.895405 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:07.899203 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:07.903508 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:07.905494 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:07.926791 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Going to run 1 instances... {{(pid=127415) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:52:07.937879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:52:08.099876 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e9f2428a-d3f1-40cc-aa21-717feef48ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.791237 Aug 24 04:52:08.111975 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 205/397] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 04:52:08.127427 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:08.136265 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:08.165185 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:08.177500 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:08.177971 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:08.178780 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:08.179285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:08.180503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:08.224969 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:08.259917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f295e58e-14d0-4e56-8fa3-7ed7bfd5283d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1272 microversion: 2.1 time: 0.429766 Aug 24 04:52:08.265792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 193/398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:07 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1272 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:08.283498 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:08.292447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:08.312256 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:08.316545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:08.316794 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:08.319343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:08.319946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:08.322244 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:08.352119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:08.365460 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-096035ed-af0e-422e-b277-b3ef8a393920 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1198 microversion: 2.1 time: 0.251934 Aug 24 04:52:08.377030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 206/399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:08 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1198 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:08.382419 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3a74b41b-e9d1-4d4e-b8ad-d17e9d46981d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:08.394151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3a74b41b-e9d1-4d4e-b8ad-d17e9d46981d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:08.566243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:08.582189 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3dc2d4df-97e2-45ea-9fed-04aa45d21b36 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1315 microversion: 2.1 time: 0.311400 Aug 24 04:52:08.589235 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 194/400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:08 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:08.674517 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3a74b41b-e9d1-4d4e-b8ad-d17e9d46981d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:08.682778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3a74b41b-e9d1-4d4e-b8ad-d17e9d46981d tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1218 microversion: 2.1 time: 0.304229 Aug 24 04:52:08.683485 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 207/401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:08 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1218 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:08.849649 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:08.850651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:08.872640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:08.873954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:08.877284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:08.880659 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:08.881361 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:08.884180 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.274597 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:09.290249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:09.292438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:09.294055 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3410050f-3f45-4f70-885d-dfabeb42010f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.451073 Aug 24 04:52:09.305983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 195/402] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:08 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:09.310411 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:09.312396 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:09.342549 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.343079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.344507 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.345083 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.353040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.354259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.404300 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:09.405549 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:09.423470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.424082 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.424573 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.426853 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.430690 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.443420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.639796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:09.656621 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d2b41a50-808c-46b0-bfc8-cde7c6a47b57 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1272 microversion: 2.1 time: 0.363954 Aug 24 04:52:09.658489 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 208/403] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:09 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1272 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:09.667412 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:09.701388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:09.703626 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:09.704427 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-216ce9b7-0e4f-488b-bf29-289ac0861145 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1198 microversion: 2.1 time: 0.304300 Aug 24 04:52:09.714275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 196/404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:09 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1198 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:09.739910 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:09.743190 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:09.744441 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.745460 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.753461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.754948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.760434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.761581 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.762564 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.764148 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.765070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.766025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.769990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.770912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.990085 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:10.026475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3810d95b-86b4-41b7-b41f-f407825a9d91 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1222 microversion: 2.1 time: 0.312039 Aug 24 04:52:10.054597 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 197/405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:09 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1222 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:10.116058 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:10.130454 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-607da591-12ae-45cc-94be-2226c544ab38 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.469920 Aug 24 04:52:10.131684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 209/406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:09 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:10.328943 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:10.329803 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:10.343793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:10.344318 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:10.344825 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:10.345759 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:10.346948 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:10.348175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:10.704019 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:10.706531 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:10.790158 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:10.793723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:10.795793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:10.799216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:10.803964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:10.808049 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:10.882099 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:10.911286 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:10.916164 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:10.918196 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f962aec1-ef57-4f6e-8c38-f7a2c0d9b42a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.597545 Aug 24 04:52:10.919257 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 198/407] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:10 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:52:10.929313 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:10.932404 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:10.950330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:10.952531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:10.954687 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:10.957350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:10.958377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:10.959313 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:11.387302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:11.408360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9c18b1bd-1d4a-45b4-8c43-8c9405c5d1b8 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.712941 Aug 24 04:52:11.418773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:11.427631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 210/408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:10 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:11.446110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:11.447979 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:11.460247 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:11.461548 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:11.462586 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:11.464110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:11.465199 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:11.466172 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:11.478841 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b3271f09-43a1-4fda-a208-aa8a2c6bba4f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.557854 Aug 24 04:52:11.485204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 199/409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:10 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:11.494599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:11.496468 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:11.512229 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:11.512730 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:11.513167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:11.513892 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:11.514405 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:11.517663 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:11.603335 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:11.612967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1d203277-151d-44e3-b25f-8aca0d73ddf5 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1214 microversion: 2.1 time: 0.183079 Aug 24 04:52:11.613977 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 211/410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:11 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:11.794262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:11.813750 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ac8f37b2-b3aa-46ec-a300-5de34d9d5f4c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.326111 Aug 24 04:52:11.814996 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 200/411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:11 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:11.958225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:11.958225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:11.968259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:11.969146 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:11.969812 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:11.970838 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:11.971505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:11.972042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:12.159232 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:12.168711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:12.170319 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:12.172949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-dc607167-825e-41c6-a2f2-a1ea354f8dfe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.231781 Aug 24 04:52:12.182537 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 212/412] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:11 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:12.451635 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:12.454184 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:12.467733 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:12.473557 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:12.473557 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:12.473557 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:12.473557 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:12.474056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:12.504449 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:12.505418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:12.515637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:12.516534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:12.517534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:12.518932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:12.520454 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:12.521276 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:12.734124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:12.738444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=100 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:12.757062 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-62222c66-e872-46ec-9853-51f653a5d32a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.315056 Aug 24 04:52:12.758308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 201/413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:12 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:12.763573 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:12.764473 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:12.777054 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:12.777289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:12.777956 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:12.778598 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:12.779496 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:12.780102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:12.780861 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:12.785450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:12.788354 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9778dc36-cf55-407a-8538-aeb9e4f7fdec tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.288562 Aug 24 04:52:12.802490 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 213/414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:12 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:12.845993 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:12.846762 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:12.856617 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:12.856617 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:12.857193 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:12.857975 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:12.858505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:12.858928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:12.873679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:12.885542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ecbc4601-8fdd-43d8-9fed-ff7600236ee6 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1214 microversion: 2.1 time: 0.125619 Aug 24 04:52:12.891996 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 202/415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:12 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:13.044181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:13.059205 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-145db695-8ccb-4e71-824b-1f4f049e566b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.217750 Aug 24 04:52:13.060398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 214/416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:12 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:13.200425 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:13.200842 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:13.209128 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:13.209861 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:13.210649 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:13.212411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:13.213130 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:13.215416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:13.471349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:13.484072 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:13.485958 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:13.487205 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-40d91764-09e5-4e70-9609-ce4928f63f9c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.293803 Aug 24 04:52:13.487783 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 203/417] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:13 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:52:13.793233 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:13.794447 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:13.813612 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:13.815201 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:13.815387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:13.815552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:13.816570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:13.818294 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:13.818497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:13.819598 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:13.821721 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:13.822250 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:13.822700 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:13.823546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:13.824022 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:13.824629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:14.096793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:14.101958 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:14.110420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1cb005ef-26de-478c-96d4-1930b9171e1b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.321600 Aug 24 04:52:14.111557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 215/418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:13 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:14.112429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b272fe08-1c2c-4c86-82dc-5a0ac408ce3c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.303132 Aug 24 04:52:14.127201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:14.128423 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 204/419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:13 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:14.130206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:14.135253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:14.136029 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:14.141901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:14.142811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:14.143561 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:14.143931 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:14.144517 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:14.144794 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:14.145167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:14.145615 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:14.146080 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:14.146360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:14.146967 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:14.147482 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:14.280603 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:14.290398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-690df3f3-30be-467c-b03a-f8c7b1f0f0ca tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1214 microversion: 2.1 time: 0.176755 Aug 24 04:52:14.298055 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 216/420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:14 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:14.362311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:14.378630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-30c1a44a-b442-444e-af82-554522725c09 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.248529 Aug 24 04:52:14.379508 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 205/421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:14 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:14.522179 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:14.522737 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:14.533162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:14.533662 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:14.534128 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:14.534847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:14.535310 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:14.535733 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:14.718120 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:14.728884 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:14.730919 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:14.731826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b588a991-ebd5-48c6-adf3-acd6a03d5fbc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.214925 Aug 24 04:52:14.732395 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 217/422] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:14 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:15.145563 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:15.147327 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:15.149203 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:15.152596 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:15.163672 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.171300 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.172238 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.172993 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.173633 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.174263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.178680 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.180001 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.180337 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.180946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.181417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.182117 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.478946 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:15.481085 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:15.499593 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-6be81eb9-2813-488e-9980-6ae000ef6f0d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.364623 Aug 24 04:52:15.500834 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 206/423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:15 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:15.508868 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-555c18ce-1197-4613-b18e-2a4b008cf44e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.368437 Aug 24 04:52:15.522034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 218/424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:15 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:15.522289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:15.522289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:15.522461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:15.522461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:15.522461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.528117 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.528304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.528304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.528514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.528620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.528701 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.528787 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.528787 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.528944 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.528944 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.529712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.659716 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:15.669159 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-55f2033d-8607-453b-8047-4ac114663305 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1214 microversion: 2.1 time: 0.166952 Aug 24 04:52:15.669759 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 207/425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:15 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:15.754420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:15.757459 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:15.758973 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:15.768481 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.769222 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.769786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.770717 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:15.771287 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:15.772079 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:15.781858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5d45de2d-9a0d-4ce2-b48c-483ca6db3bd1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.268829 Aug 24 04:52:15.782943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 219/426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:15 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:16.003199 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:16.014370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:16.016130 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:16.017377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1f949bc7-6b46-404a-85e2-72cd743b31ac tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.264461 Aug 24 04:52:16.018160 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 208/427] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:15 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:52:16.538071 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:16.539574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:16.540147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:16.540259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:16.547637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:16.548411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:16.549223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:16.550055 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:16.550340 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:16.550652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:16.551153 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:16.551469 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:16.552360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:16.553742 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:16.554722 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:16.555479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:16.795048 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:16.797850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:16.804113 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e55cb8ba-cb65-47e4-aa8f-42382cd46c0b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.270558 Aug 24 04:52:16.807849 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0642c31f-760b-4e37-bfaa-10daa1138b49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.274512 Aug 24 04:52:16.808443 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 220/428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:16 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:16.813444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:16.814538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:16.817858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 209/429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:16 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:16.822265 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:16.823472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:16.823992 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:16.824240 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:16.824606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:16.825962 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:16.827865 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:16.831286 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:16.831488 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:16.831958 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:16.832407 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:16.833138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:16.833594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:16.834059 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:16.937735 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:16.947432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e8535963-d87f-4556-8716-7646615665bd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1214 microversion: 2.1 time: 0.137817 Aug 24 04:52:16.948397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 221/430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:16 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:17.021902 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:17.031580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bd2fb09e-6dc6-44b5-8cc2-c98a65c36b27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.212417 Aug 24 04:52:17.032195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 210/431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:16 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:17.051029 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:17.051575 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:17.058489 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:17.058978 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:17.059411 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:17.060119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:17.060574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:17.061000 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:17.212521 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:17.221220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:17.222990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:17.224221 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b894ff82-b458-4323-9b32-17a4da498674 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1741 microversion: 2.20 time: 0.177382 Aug 24 04:52:17.224856 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 222/432] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:17 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:17.829839 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:17.830970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:17.836778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:17.837812 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:17.840020 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=6 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:17.840790 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:17.840930 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:17.841392 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:17.842492 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:17.842930 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:17.843352 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:17.846322 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:17.847253 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:17.848010 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:17.849050 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:17.850223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:17.850738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:18.091923 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:18.107141 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:18.107338 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6de76e3e-8dcf-4a24-a8c2-3fe894d2b79b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.274979 Aug 24 04:52:18.108486 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 223/433] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:17 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:18.113807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:18.114544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:18.121431 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:18.122037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:18.122557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:18.123341 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:18.124035 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:18.124549 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:18.129628 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-890bae8b-aa55-42c1-a045-41709a2f801d tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.305897 Aug 24 04:52:18.131034 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 211/434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:17 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:18.149928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:18.151317 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:18.158283 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:18.158770 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:18.159221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:18.160007 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:18.160374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:18.160796 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:18.244310 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:18.259707 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7af3edac-158a-4781-a4de-3767fff23374 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1270 microversion: 2.1 time: 0.149024 Aug 24 04:52:18.261805 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 224/435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:18 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:18.269006 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:18.269629 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:18.287870 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:18.291593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:18.292253 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:18.293132 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:18.293615 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:18.294091 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:18.420701 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:18.433989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-781ad71d-17e8-40bc-a7de-7aa4f812d025 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.302183 Aug 24 04:52:18.434629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 212/436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:18 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:18.673647 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:18.684751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=26 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:18.697072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:18.699536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:18.703859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d9a97b24-8119-4ae8-884b-d08b0096a932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1723 microversion: 2.20 time: 0.440549 Aug 24 04:52:18.704730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 225/437] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:18 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1723 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:19.135304 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:19.136459 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:19.143957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:19.144531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:19.145164 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:19.145910 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:19.146946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:19.147341 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:19.153832 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:19.154447 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:19.169536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:19.170432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:19.171547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:19.172981 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:19.174154 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:19.175026 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:19.529349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:19.541464 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:19.546800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f0375b50-66a9-4a0f-8f03-a40317952f62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.417864 Aug 24 04:52:19.548028 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 213/438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:19 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:19.553537 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:19.555241 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:19.564188 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:19.565278 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:19.565995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:19.567016 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:19.567637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:19.568213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:19.574844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9ea27428-e5af-4281-865f-b34dc9bf9737 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.424621 Aug 24 04:52:19.575943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 226/439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:19 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:19.581803 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:19.582760 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:19.589943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:19.591153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:19.591661 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:19.592639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:19.593362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:19.593984 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:20.006947 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:20.016292 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:20.022268 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-994955e3-143e-4414-a4a0-5dc2bb1ca544 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.472753 Aug 24 04:52:20.023934 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 214/440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:19 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:20.042739 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a0345acb-0e75-4efe-bba4-133807532342 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.460597 Aug 24 04:52:20.043826 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:20.044824 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:20.051922 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:20.053269 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:20.054912 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:20.055925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:20.056621 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:20.057266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:20.058664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 227/441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:19 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:20.065897 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-acbeab7d-34e2-40bc-93de-b7e8ff6c3997 req-9224e596-3c64-4b7b-88dd-8ccbf7ab30ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57311393-dc24-4693-a167-bafcb80a8c46", "tag": "285aec92-b5fd-4f9f-bcd0-e92475d6d6bc"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:20.083072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-acbeab7d-34e2-40bc-93de-b7e8ff6c3997 req-9224e596-3c64-4b7b-88dd-8ccbf7ab30ae service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:20.083898 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-acbeab7d-34e2-40bc-93de-b7e8ff6c3997 req-9224e596-3c64-4b7b-88dd-8ccbf7ab30ae service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:20.084474 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-acbeab7d-34e2-40bc-93de-b7e8ff6c3997 req-9224e596-3c64-4b7b-88dd-8ccbf7ab30ae service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:20.099807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-acbeab7d-34e2-40bc-93de-b7e8ff6c3997 req-9224e596-3c64-4b7b-88dd-8ccbf7ab30ae service nova] Creating event network-changed:285aec92-b5fd-4f9f-bcd0-e92475d6d6bc for instance 57311393-dc24-4693-a167-bafcb80a8c46 on hv-cinder-85426 Aug 24 04:52:20.109555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-acbeab7d-34e2-40bc-93de-b7e8ff6c3997 req-9224e596-3c64-4b7b-88dd-8ccbf7ab30ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047292 Aug 24 04:52:20.110532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 228/442] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:20.365810 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:20.377200 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:20.379614 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:20.381006 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2db1c9b5-b9e5-4c31-b6ac-b45a2c25fd39 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1723 microversion: 2.20 time: 0.355795 Aug 24 04:52:20.381939 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 215/443] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:20 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:20.572815 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:20.573536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:20.585504 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:20.586624 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:20.586906 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:20.587520 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:20.587990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:20.588415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:20.601593 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:20.604137 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:20.620416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:20.621672 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:20.622437 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:20.624037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:20.624821 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:20.625610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:20.905769 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:20.915888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-41012fb2-1cdb-4269-9337-3112641f8bb2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.347523 Aug 24 04:52:20.916471 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 229/444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:20 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:20.956606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:20.965398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e0e3d9b4-b9ad-455c-9f4f-e4e0e73f5c1e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.372034 Aug 24 04:52:20.965991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 216/445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:20 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:21.050333 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-7a38bc53-9a76-4aea-a684-41c5c86cc202 req-ea8c29f1-dd7e-4e36-8623-3affdd1fd10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30222b89-a924-4cd1-bc8f-94ce4ff4cee2", "tag": "f73da800-22b2-456d-be85-48f961ca29fe"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:21.050598 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:21.051126 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:21.059711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.060291 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.060789 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.061564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.061861 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7a38bc53-9a76-4aea-a684-41c5c86cc202 req-ea8c29f1-dd7e-4e36-8623-3affdd1fd10f service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.062180 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.062575 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7a38bc53-9a76-4aea-a684-41c5c86cc202 req-ea8c29f1-dd7e-4e36-8623-3affdd1fd10f service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.062883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.063131 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7a38bc53-9a76-4aea-a684-41c5c86cc202 req-ea8c29f1-dd7e-4e36-8623-3affdd1fd10f service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.077722 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-7a38bc53-9a76-4aea-a684-41c5c86cc202 req-ea8c29f1-dd7e-4e36-8623-3affdd1fd10f service nova] Creating event network-changed:f73da800-22b2-456d-be85-48f961ca29fe for instance 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 on hv-cinder-85426 Aug 24 04:52:21.083037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-7a38bc53-9a76-4aea-a684-41c5c86cc202 req-ea8c29f1-dd7e-4e36-8623-3affdd1fd10f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036293 Aug 24 04:52:21.083652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 217/446] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:52:21.090213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:21.091107 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:21.098100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.098857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.099306 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.100024 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.103728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.103728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.276141 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:21.285162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-47900af1-be61-429a-a74f-0979c36b7e7e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.238676 Aug 24 04:52:21.285756 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 230/447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:21 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:21.305441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:21.313753 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a4379b4d-efe4-4196-b5da-563cf530aca4 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.228689 Aug 24 04:52:21.315025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 218/448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:21 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:21.405072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:21.405679 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:21.412225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.412704 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.413131 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.414396 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.414888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.415250 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.418303 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:21.556476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:21.564888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:21.566462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:21.568477 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c5ace2eb-8ef3-4a74-8fb0-eaa4fa1ec2e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1723 microversion: 2.20 time: 0.167335 Aug 24 04:52:21.569054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 231/449] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:21 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:21.936718 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:21.937355 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:21.943988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.944370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.945406 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.946464 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.946921 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.947349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.951717 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=100 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:21.986481 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:21.987095 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:21.995334 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.995830 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.996272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.996976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.997616 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.998062 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.143610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:22.152052 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a174e3b5-0e2a-46c6-ba11-39af2b19d114 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.219117 Aug 24 04:52:22.152741 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 219/450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:21 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:22.168319 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:22.170563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-7c47944c-3c5b-4faf-8040-17b3d92a37e2 req-e1b14989-15ef-4a5e-9d77-58e559995250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eeaea49-9c15-4e0a-a446-98d3191293c8", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd895e9-3f00-4d89-aab3-7b4bbc97e62d"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:22.176243 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2d7d98fa-1b88-4faa-ba6e-73f7cce7e364 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.193752 Aug 24 04:52:22.176785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 232/451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:21 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:22.182096 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-c248d1db-089d-427c-b06c-4c1581475cb7 req-d279be8c-c21c-4a3e-87f7-dedb29e1d5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4327844a-a418-4575-85e9-f50eba8c41d9", "tag": "ebf9f963-0b36-489c-9bb2-41ef21b12c4e"}, {"name": "network-changed", "server_uuid": "82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02", "tag": "cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:22.183262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7c47944c-3c5b-4faf-8040-17b3d92a37e2 req-e1b14989-15ef-4a5e-9d77-58e559995250 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.183927 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7c47944c-3c5b-4faf-8040-17b3d92a37e2 req-e1b14989-15ef-4a5e-9d77-58e559995250 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.184486 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7c47944c-3c5b-4faf-8040-17b3d92a37e2 req-e1b14989-15ef-4a5e-9d77-58e559995250 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.192991 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-c248d1db-089d-427c-b06c-4c1581475cb7 req-d279be8c-c21c-4a3e-87f7-dedb29e1d5b2 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.193463 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-c248d1db-089d-427c-b06c-4c1581475cb7 req-d279be8c-c21c-4a3e-87f7-dedb29e1d5b2 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.193881 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-c248d1db-089d-427c-b06c-4c1581475cb7 req-d279be8c-c21c-4a3e-87f7-dedb29e1d5b2 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.198569 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-7c47944c-3c5b-4faf-8040-17b3d92a37e2 req-e1b14989-15ef-4a5e-9d77-58e559995250 service nova] Creating event network-vif-unplugged:6bd895e9-3f00-4d89-aab3-7b4bbc97e62d for instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 on hv-cinder-85426 Aug 24 04:52:22.203941 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-7c47944c-3c5b-4faf-8040-17b3d92a37e2 req-e1b14989-15ef-4a5e-9d77-58e559995250 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036835 Aug 24 04:52:22.204809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 220/452] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:22.207334 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-c248d1db-089d-427c-b06c-4c1581475cb7 req-d279be8c-c21c-4a3e-87f7-dedb29e1d5b2 service nova] Creating event network-changed:ebf9f963-0b36-489c-9bb2-41ef21b12c4e for instance 4327844a-a418-4575-85e9-f50eba8c41d9 on hv-cinder-85426 Aug 24 04:52:22.207710 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-c248d1db-089d-427c-b06c-4c1581475cb7 req-d279be8c-c21c-4a3e-87f7-dedb29e1d5b2 service nova] Creating event network-changed:cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7 for instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 on hv-cinder-85426 Aug 24 04:52:22.214648 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-c248d1db-089d-427c-b06c-4c1581475cb7 req-d279be8c-c21c-4a3e-87f7-dedb29e1d5b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036636 Aug 24 04:52:22.215271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 233/453] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:22.308559 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:22.309402 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:22.315773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.316273 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.316691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.317385 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.317836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.318291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.337330 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:22.338511 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:22.348323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.349104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.349828 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.351652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.352406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.353114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.531448 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:22.539483 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:22.541001 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c25c5268-11f2-4a19-ad06-bd128686cc7a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.237010 Aug 24 04:52:22.541593 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 221/454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:22 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:22.547564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-af36302d-1c7d-4d8a-9dfc-db444e13bebd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.215521 Aug 24 04:52:22.548136 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 234/455] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:22 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:22.592361 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:22.592964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:22.599770 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.600267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.600671 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.601988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.602659 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.603080 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.756570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:22.768634 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:22.770251 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:22.771652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1822ac20-a99c-47cf-b90e-0a1ba22f6034 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1723 microversion: 2.20 time: 0.183040 Aug 24 04:52:22.772219 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 222/456] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:22 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:52:23.172851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:23.173424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:23.175436 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:23.181086 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.181561 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.181985 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.182708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.183150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.183567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.197987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:23.198601 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:23.205238 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.205720 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.206191 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.206934 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.207391 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.207818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.630435 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:23.638895 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d8a9d30b-f87c-48ad-88ae-da21ac8a1767 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.469779 Aug 24 04:52:23.639485 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 235/457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:23 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:23.644587 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:23.645199 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:23.652309 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.652834 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.653267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.653983 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.654479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.654989 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.669459 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:23.678535 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c6cb2dd8-4738-472c-a4f1-25e38ed8ae0e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.484517 Aug 24 04:52:23.679243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 223/458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:23 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:23.696832 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:23.697435 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:23.703932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.704410 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.704840 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.705545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.706018 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.706470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.931407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:23.941940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-afd9db08-c7eb-4436-88ab-cd3a210827d2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.301007 Aug 24 04:52:23.942555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 236/459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:23 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:23.948608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:23.949490 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:23.955947 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.956718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.957151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.957857 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.958338 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.958757 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.966470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:23.975112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c96f2e96-377a-40eb-9664-2c140d603daa tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.294574 Aug 24 04:52:23.976114 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 224/460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:23 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:24.118451 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:24.127438 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:24.128961 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:24.130171 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-56d6997a-73ec-4e5b-917f-c37a0dd5d48b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1666 microversion: 2.20 time: 0.186439 Aug 24 04:52:24.130752 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 237/461] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:23 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1666 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:24.154690 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a4bf5d0e-f3b8-4632-8d03-d1a6d12db11b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3abf31a-a9c0-4b2d-a205-ec3e36f64422"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:24.157324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a4bf5d0e-f3b8-4632-8d03-d1a6d12db11b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:24.163643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d0e-f3b8-4632-8d03-d1a6d12db11b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.164135 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d0e-f3b8-4632-8d03-d1a6d12db11b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.164649 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d0e-f3b8-4632-8d03-d1a6d12db11b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.166550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d0e-f3b8-4632-8d03-d1a6d12db11b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.167010 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d0e-f3b8-4632-8d03-d1a6d12db11b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.167434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d0e-f3b8-4632-8d03-d1a6d12db11b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.476551 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a4bf5d0e-f3b8-4632-8d03-d1a6d12db11b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325744 Aug 24 04:52:24.477257 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 225/462] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Aug 24 04:52:24 2022] POST /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:52:24.605784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:24.606417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:24.613007 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.613610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.614209 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.614927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.615383 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.615810 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.660332 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:24.660952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:24.667728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.667991 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127415) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 04:52:24.668249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.668687 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.669397 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.669850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.670307 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.753902 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f642d99d-f622-42f8-90b0-72837011566d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/action" status: 202 len: 0 microversion: 2.20 time: 0.152216 Aug 24 04:52:24.755263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 238/463] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 24 04:52:24 2022] POST /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:52:24.765532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:24.766759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:24.778541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.779434 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.780321 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.782604 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.783514 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.784316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.891310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:24.899614 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-72f2d5fb-2f73-4500-83b7-03c4a5fd08fb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.243404 Aug 24 04:52:24.900197 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 226/464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:24 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:24.906322 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:24.907221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:24.914469 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.915581 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.916253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.917544 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.918176 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.918815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.983150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:24.998656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ba629d8f-a6fe-473b-93ac-e0cbac5327ad tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.242118 Aug 24 04:52:24.999600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 239/465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:24 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:25.011093 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:25.012077 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:25.019058 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:25.019549 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:25.019985 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:25.020680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:25.021408 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:25.022048 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:25.166146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:25.180848 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:25.183187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:25.184733 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-430fd2b2-7fa1-444e-806a-bda09b1d19fa tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1752 microversion: 2.20 time: 0.282735 Aug 24 04:52:25.185437 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 227/466] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:24 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1752 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:25.190749 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:25.191512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:25.199634 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:25.200566 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:25.201240 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:25.202288 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:25.203103 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:25.203777 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:25.274817 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:25.286384 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8e187c66-6fdd-4dcc-b241-aeeb7a79c224 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.285380 Aug 24 04:52:25.289529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 240/467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:24 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:25.390430 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:25.409057 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f95ee835-bae4-404a-bf5c-33023cf2878c tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.222226 Aug 24 04:52:25.410094 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 228/468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:25 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:25.923020 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:25.923634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:25.931028 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:25.931609 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:25.932370 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:25.933260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:25.933714 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:25.934242 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.020643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:26.021572 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:26.028806 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.029293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.029727 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.030597 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.030907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.031420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.120305 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:26.129505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-003a0caa-9e21-4563-a491-ab78594d8c49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.212119 Aug 24 04:52:26.130506 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 241/469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:25 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:26.160222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:26.161369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:26.176172 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.178642 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.179224 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.180308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.180967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.181500 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.212828 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:26.226262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-387cf34e-a5fe-4c9d-b2ec-2ee6de1b0bc1 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.209294 Aug 24 04:52:26.227568 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 229/470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:26 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:26.243100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:26.244093 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:26.257204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.259280 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.261377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.263904 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.264701 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.264981 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.366937 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lazy-loading 'services' on Instance uuid 02869b36-2e27-488f-9e94-c82e7094038d {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:52:26.519423 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:26.531918 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:26.533763 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:26.535742 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ed51ed1f-4ce5-4dc6-b5bb-b400556570fc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1752 microversion: 2.20 time: 0.306868 Aug 24 04:52:26.555588 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 230/471] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:26 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1752 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:26.563246 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:26.564197 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:26.571865 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.572789 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.573917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.575074 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.576196 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.576895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.584031 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f4cca260-b27a-4ab2-868c-2c909895c3aa tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "DELETE /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/os-volume_attachments/d4568723-b559-4292-969b-2032eb3e5ab5" status: 202 len: 0 microversion: 2.1 time: 0.428324 Aug 24 04:52:26.587966 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 242/472] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:52:26 2022] DELETE /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/os-volume_attachments/d4568723-b559-4292-969b-2032eb3e5ab5 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:52:26.604729 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:26.608066 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:26.625324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.626460 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.630387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.632860 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.633637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.634480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.996963 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:27.007109 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d5af52b3-0d6f-4cdb-a285-8cb7820dadcd tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.449194 Aug 24 04:52:27.007703 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 231/473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:26 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:27.036097 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:27.043904 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-98af39c1-1eee-4e43-897d-524dd221cde2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.457536 Aug 24 04:52:27.044476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 243/474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:26 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:27.150739 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:27.151522 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:27.157841 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:27.158365 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:27.158793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:27.159476 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:27.159919 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:27.160332 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:27.251847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:27.252450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:27.258409 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:27.258892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:27.259323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:27.260052 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:27.261144 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:27.261748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:27.297002 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:27.305893 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-24ed1ab1-340f-4bdf-a385-9dcfe19d99cb tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.159019 Aug 24 04:52:27.306524 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 232/475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:27 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:27.396219 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:27.405704 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9cf24edb-48a7-4451-8416-3adb0b6186b9 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.157554 Aug 24 04:52:27.406314 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 244/476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:27 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:27.561283 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:27.561883 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:27.568213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:27.568693 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:27.569124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:27.569810 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:27.570296 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:27.570724 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:27.711586 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:27.714464 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:27.723497 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:27.724988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:27.726172 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0a1ed696-3449-4073-9f43-15bd2bc42c91 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1754 microversion: 2.20 time: 0.169219 Aug 24 04:52:27.726885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 233/477] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:27 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:52:28.029478 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:28.030154 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:28.036771 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.037492 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.037680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.038424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.038875 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.039292 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.066308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:28.067231 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:28.096726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.097110 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.097598 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.098491 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.098968 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.099396 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.324330 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:28.340445 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9e04b0e9-0db3-4d28-a7df-4f3f1e173ae4 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.314949 Aug 24 04:52:28.341162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 245/478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:28 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:28.348524 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-c608ddcb-a009-49af-9dee-78be82516b4f req-3f227aa8-0493-473c-89fc-84016fd3e067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02", "name": "network-vif-plugged", "status": "completed", "tag": "cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:28.364143 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-c608ddcb-a009-49af-9dee-78be82516b4f req-3f227aa8-0493-473c-89fc-84016fd3e067 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.365100 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-c608ddcb-a009-49af-9dee-78be82516b4f req-3f227aa8-0493-473c-89fc-84016fd3e067 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.366085 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-c608ddcb-a009-49af-9dee-78be82516b4f req-3f227aa8-0493-473c-89fc-84016fd3e067 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.375842 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:28.383069 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-c608ddcb-a009-49af-9dee-78be82516b4f req-3f227aa8-0493-473c-89fc-84016fd3e067 service nova] Creating event network-vif-plugged:cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7 for instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 on hv-cinder-85426 Aug 24 04:52:28.389640 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-c608ddcb-a009-49af-9dee-78be82516b4f req-3f227aa8-0493-473c-89fc-84016fd3e067 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046569 Aug 24 04:52:28.390941 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 246/479] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:28.399691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:28.400486 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:28.404483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e8331516-5f93-4091-994b-55ee273c994d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.340601 Aug 24 04:52:28.406124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 234/480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:28 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:28.412236 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.413104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.413901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.415250 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.416358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.417598 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.428556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:28.429647 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:28.440795 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:28.441080 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.441886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.442982 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.444298 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.445280 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.446244 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.655819 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:28.670413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-031acf1e-fae0-44a0-bcf7-d454f163c6e8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.272777 Aug 24 04:52:28.671016 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:28.671506 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 247/481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:28 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:28.691202 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-abbdf80a-27f4-45b2-b9a1-7d8e0b90ca9a tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.259228 Aug 24 04:52:28.706825 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 235/482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:28 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:28.756684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:28.758173 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:28.769332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.770536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.771864 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.773294 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.774423 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.775414 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.989644 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:29.002028 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:29.003571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:29.004752 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-fe7e6436-f3e8-43d2-a082-828521c4d40e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1754 microversion: 2.20 time: 0.256776 Aug 24 04:52:29.005380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 248/483] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:28 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1754 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:29.363214 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:29.364297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:29.372321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.372932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.373444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.374308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.374863 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.375404 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.426273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:29.426884 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:29.434879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.435372 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.435815 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.436594 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.437223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.437657 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.594914 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:29.607133 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-050dfdcc-850a-4a9c-a66b-1a260aa6b01c tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.246457 Aug 24 04:52:29.607753 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 236/484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:29 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:29.663476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:29.672585 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6f4340d1-91a0-4066-977c-bfad1fa39b06 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.250087 Aug 24 04:52:29.674906 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 249/485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:29 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:29.705945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:29.706584 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:29.713332 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.713827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.714425 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.715284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.715622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.716056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.722700 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:29.723275 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:29.731370 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.731854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.732298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.733032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.733479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.733900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.998911 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:30.011959 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9709079b-4137-48ce-92aa-1160bd0f0ef7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.310920 Aug 24 04:52:30.027088 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 237/486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:29 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:30.034300 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9df73a75-6ff5-4a22-a96e-470fb434db77 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:30.043187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9df73a75-6ff5-4a22-a96e-470fb434db77 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.044057 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9df73a75-6ff5-4a22-a96e-470fb434db77 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.045144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9df73a75-6ff5-4a22-a96e-470fb434db77 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.071023 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:30.082196 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d60b47be-3cfe-4a17-a362-0c96a0222669 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.365041 Aug 24 04:52:30.082884 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 250/487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:29 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:30.087422 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9df73a75-6ff5-4a22-a96e-470fb434db77 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Going to try to stop instance {{(pid=127416) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 04:52:30.089595 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:30.090626 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:30.105843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.106572 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.107352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.108718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.109738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.110340 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.147691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9df73a75-6ff5-4a22-a96e-470fb434db77 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/action" status: 202 len: 0 microversion: 2.1 time: 0.118401 Aug 24 04:52:30.151826 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 238/488] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:52:30 2022] POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:52:30.158637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:30.159487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:30.167763 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.168898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.169504 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.170470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.171065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.171670 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.360928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:30.381109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:30.387143 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:30.389830 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3e5c999f-7799-46ac-9af0-fb044b52b29f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.304627 Aug 24 04:52:30.391459 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 251/489] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:30 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:30.420050 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:30.431585 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3f09f440-a6a5-4525-9d60-b987ee4e0b97 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.277484 Aug 24 04:52:30.433793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 239/490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:30 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:30.440391 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-1572d7bc-d45b-4ec4-b455-182f702dc91a req-6233d225-b0d8-4cad-87d8-a8e8ac2f625f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4327844a-a418-4575-85e9-f50eba8c41d9", "name": "network-vif-plugged", "status": "completed", "tag": "ebf9f963-0b36-489c-9bb2-41ef21b12c4e"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:30.460334 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-1572d7bc-d45b-4ec4-b455-182f702dc91a req-6233d225-b0d8-4cad-87d8-a8e8ac2f625f service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.461223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-1572d7bc-d45b-4ec4-b455-182f702dc91a req-6233d225-b0d8-4cad-87d8-a8e8ac2f625f service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.462238 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-1572d7bc-d45b-4ec4-b455-182f702dc91a req-6233d225-b0d8-4cad-87d8-a8e8ac2f625f service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.480844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-1572d7bc-d45b-4ec4-b455-182f702dc91a req-6233d225-b0d8-4cad-87d8-a8e8ac2f625f service nova] Creating event network-vif-plugged:ebf9f963-0b36-489c-9bb2-41ef21b12c4e for instance 4327844a-a418-4575-85e9-f50eba8c41d9 on hv-cinder-85426 Aug 24 04:52:30.486083 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-1572d7bc-d45b-4ec4-b455-182f702dc91a req-6233d225-b0d8-4cad-87d8-a8e8ac2f625f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078617 Aug 24 04:52:30.486698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 252/491] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:30.641588 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:30.644496 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:30.657627 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.658104 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.658655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.659354 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.659805 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.660892 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.698781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:30.699569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:30.706501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.707471 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.707982 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.708768 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.709231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.709660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.861896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:30.870579 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3637dd83-cf81-4dd6-933e-056e3fec9d48 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.238421 Aug 24 04:52:30.871528 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 240/492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:30 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:30.891868 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:30.900111 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-368975a2-9743-413c-8145-fad387d56170 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.206816 Aug 24 04:52:30.900818 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 253/493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:30 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:31.039435 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:31.040039 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:31.046956 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.047444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.047876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.048591 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.049025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.049448 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.117175 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:31.117934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:31.125832 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.126161 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.126605 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.127307 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.127908 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.128336 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.215327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:31.223355 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-34902760-5314-40b4-8032-8a3a2e6da266 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.187727 Aug 24 04:52:31.223936 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 241/494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:31 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:31.283018 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:31.291541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c51240c5-4e5b-46d4-8e93-10a83a904bfe tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.177726 Aug 24 04:52:31.292159 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 254/495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:31 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:31.435727 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:31.437033 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:31.444206 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.445020 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.445443 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.446328 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.446924 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.447360 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.456473 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:31.457701 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:31.473697 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.474488 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.475098 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.475999 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.476621 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.477198 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.712447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:31.723870 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:31.724079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:31.725393 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:31.726640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-26acf55e-a1c0-4797-9604-a471241f9138 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.295002 Aug 24 04:52:31.727283 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 242/496] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:31 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:31.734339 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f20eecdf-dd63-424c-b0fa-729e359ade65 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.281534 Aug 24 04:52:31.734938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 255/497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:31 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:31.892549 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:31.893157 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:31.895290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=100 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:31.901854 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.902371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.902805 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.903555 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.904036 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.904467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.933928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:31.933928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:31.949015 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.950016 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.950949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.952302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.953238 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.954108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.254925 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:32.260480 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:32.265045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f59d0c34-a30e-4e8c-8df6-360037165b87 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1357 microversion: 2.1 time: 0.341047 Aug 24 04:52:32.274274 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 256/498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:31 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:32.274274 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:32.274274 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:32.277491 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-cbe0c19e-56c5-40c9-9d19-56cd22d7ac5a tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.388907 Aug 24 04:52:32.278671 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 243/499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:31 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:32.291774 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.292284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.292715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.293432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.293884 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.294348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.312330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:32.312943 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:32.319176 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.319663 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.320098 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.320800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.321248 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.321667 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.504331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:32.512984 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:32.513289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e33864df-a474-411d-8cb8-cf44b2fbbfdf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.245575 Aug 24 04:52:32.526531 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 257/500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:32 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:32.526531 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-b6812435-46dd-44d6-8107-d1e26cf22908 req-545bac5c-1481-43d8-8147-e609d931b4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30222b89-a924-4cd1-bc8f-94ce4ff4cee2", "name": "network-vif-plugged", "status": "completed", "tag": "f73da800-22b2-456d-be85-48f961ca29fe"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:32.526876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4fd611ca-f154-407c-93ab-33fb901df800 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.213354 Aug 24 04:52:32.528878 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-b6812435-46dd-44d6-8107-d1e26cf22908 req-545bac5c-1481-43d8-8147-e609d931b4f4 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.529503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-b6812435-46dd-44d6-8107-d1e26cf22908 req-545bac5c-1481-43d8-8147-e609d931b4f4 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.529985 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-b6812435-46dd-44d6-8107-d1e26cf22908 req-545bac5c-1481-43d8-8147-e609d931b4f4 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.535172 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 244/501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:32 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:32.543701 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-b6812435-46dd-44d6-8107-d1e26cf22908 req-545bac5c-1481-43d8-8147-e609d931b4f4 service nova] Creating event network-vif-plugged:f73da800-22b2-456d-be85-48f961ca29fe for instance 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 on hv-cinder-85426 Aug 24 04:52:32.549608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-b6812435-46dd-44d6-8107-d1e26cf22908 req-545bac5c-1481-43d8-8147-e609d931b4f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034322 Aug 24 04:52:32.550409 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 258/502] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:32.750670 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:32.751234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:32.757562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.758138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.758579 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.759272 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.759500 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:32.759723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.760431 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:32.760576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.767664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.768458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.768901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.769618 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.770179 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.770622 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.972434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:32.979887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:32.983444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:32.984972 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:32.986237 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-dbbdd77d-5c2d-4575-bdb3-9c5d5f34d737 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.239520 Aug 24 04:52:32.986814 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 245/503] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:32 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:33.006503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6bc563b9-425b-4178-bc58-d6c1568962dd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.251844 Aug 24 04:52:33.007622 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 259/504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:32 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:33.287222 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:33.287902 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:33.298707 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:33.299315 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:33.304761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.308002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.308498 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.308930 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.309632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.310439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.310897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.311849 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.312299 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.312726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.317755 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.318283 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.531857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:33.534496 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:33.540198 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b88a5567-3c36-4b79-82a7-c2a63f5bf6fc tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1547 microversion: 2.1 time: 0.256794 Aug 24 04:52:33.540793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 246/505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:33 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1547 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:33.545911 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:33.546304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-36e3c47c-ee53-4139-ab08-b2570ab23714 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.251391 Aug 24 04:52:33.547054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 260/506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:33 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:33.547715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:33.553983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.554540 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.554988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.555682 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.556243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.556710 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.563976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:33.564575 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:33.570461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.570944 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.571366 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.572051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.573088 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.573507 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.997338 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.005250 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b8a148f6-9036-46d9-b0ee-a6a9208bdabf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.463121 Aug 24 04:52:34.010570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 247/507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:33 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:34.011578 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.013561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:34.014288 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:34.019698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7b3dd3d0-93c9-43af-bf85-f90f669f1753 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1314 microversion: 2.1 time: 0.459321 Aug 24 04:52:34.020294 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 261/508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:33 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:34.020438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.021411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.021850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.022588 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.023035 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.023455 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.033161 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:34.034062 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:34.040132 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.040619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.041646 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.042769 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.043237 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.043666 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.232489 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.244227 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c1d3d80d-5cc6-4b00-a318-34adca7e2911 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1547 microversion: 2.1 time: 0.237261 Aug 24 04:52:34.244912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.245332 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 248/509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:34 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1547 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:34.251000 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:34.251609 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:34.255809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.257527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.257658 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.258153 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.258502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-459c3897-dd87-4d6d-bfd2-2810828e67f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.237047 Aug 24 04:52:34.258630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.259065 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 262/510] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:34 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:34.259268 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.260247 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.260660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.273492 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:34.277944 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:34.278200 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.278778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Searching by: {'deleted': False, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374'} {{(pid=127415) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:52:34.286103 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.286589 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.287015 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.287746 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.288374 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.288965 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.384266 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.multi_cell_list [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127415) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 04:52:34.437055 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.446694 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bd550392-814e-4175-9d6e-4777ec68bdac tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.200109 Aug 24 04:52:34.448780 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 249/511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:34 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:34.491163 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2028edd8-640f-47e9-8c08-4878b8c6317f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.223302 Aug 24 04:52:34.491749 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 263/512] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Aug 24 04:52:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:52:34.503681 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:34.504321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:34.512461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.512461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.512876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.513417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.513858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.514338 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.568630 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:34.569237 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:34.576212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.576926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.577358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.578112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.578562 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.578979 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.739333 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.747461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ea75b2c9-6f72-42ff-8c86-ca96c3e6ec5f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1547 microversion: 2.1 time: 0.247638 Aug 24 04:52:34.748061 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 250/513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:34 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1547 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:34.756403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-67e685c2-bc5a-497a-8412-c6f3d9dda9fb req-7221d45d-9a91-423b-8b99-84f23b31f053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57311393-dc24-4693-a167-bafcb80a8c46", "name": "network-vif-plugged", "status": "completed", "tag": "285aec92-b5fd-4f9f-bcd0-e92475d6d6bc"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:34.763222 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-67e685c2-bc5a-497a-8412-c6f3d9dda9fb req-7221d45d-9a91-423b-8b99-84f23b31f053 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.763761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-67e685c2-bc5a-497a-8412-c6f3d9dda9fb req-7221d45d-9a91-423b-8b99-84f23b31f053 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.764130 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-67e685c2-bc5a-497a-8412-c6f3d9dda9fb req-7221d45d-9a91-423b-8b99-84f23b31f053 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.777357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.780736 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-67e685c2-bc5a-497a-8412-c6f3d9dda9fb req-7221d45d-9a91-423b-8b99-84f23b31f053 service nova] Creating event network-vif-plugged:285aec92-b5fd-4f9f-bcd0-e92475d6d6bc for instance 57311393-dc24-4693-a167-bafcb80a8c46 on hv-cinder-85426 Aug 24 04:52:34.786636 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-67e685c2-bc5a-497a-8412-c6f3d9dda9fb req-7221d45d-9a91-423b-8b99-84f23b31f053 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037302 Aug 24 04:52:34.787600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 251/514] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:34.788226 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b688d7ed-8e01-4d70-b061-06852278a98f tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.224493 Aug 24 04:52:34.789204 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 264/515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:34 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:35.030032 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:35.031344 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:35.041421 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.042093 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.042306 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:35.042727 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.043069 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:35.043637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.044332 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.044830 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.050027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.050513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.051235 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.052121 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.052900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.053345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.056584 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:35.322663 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:35.343860 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:35.350288 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5ff82135-3067-432b-801d-518aae109580 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.325459 Aug 24 04:52:35.353407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-472ddd1d-042a-48da-ac79-42dced663f42 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1463 microversion: 2.1 time: 0.315198 Aug 24 04:52:35.356135 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 265/516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:35 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1463 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:35.363397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:35.363748 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 252/517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:35 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:35.364557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:35.381947 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.382678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.383322 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.384118 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.394184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.396370 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.423447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:35.425545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:35.439078 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.439753 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.440017 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.440748 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.442630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.443234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.523498 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Going to try to terminate instance {{(pid=127416) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:52:35.714594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-33e2d7d8-e17a-4409-b162-2ddb6078c81b tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 204 len: 0 microversion: 2.1 time: 0.296152 Aug 24 04:52:35.716187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 253/518] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:52:35 2022] DELETE /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:52:35.725146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:35.729140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:35.737849 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.739198 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.739923 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.741231 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.741977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.742622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.753273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:35.765343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:35.769192 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:35.771411 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-daa37a94-7ec6-4107-a1a5-d0748ee11916 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.413663 Aug 24 04:52:35.772371 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 266/519] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:35 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:35.783260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:35.783260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:35.793298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.793298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.793298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:35.793298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:35.793926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:35.793926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.118270 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:36.122846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:36.127671 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-68d95a50-6615-42ae-9ca8-916c4f147b83 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.409155 Aug 24 04:52:36.128256 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 254/520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:35 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:36.152059 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-53b6ed56-5512-4fee-aaee-35eb4b8407d5 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.377881 Aug 24 04:52:36.153244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 267/521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:35 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:36.157032 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:36.158225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:36.169611 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.170517 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.171290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.172578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.173416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.174231 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.378386 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:36.378386 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:36.393664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.394421 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.394957 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.396024 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.396637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.397282 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.485577 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:36.511101 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0f0d9bcf-e1ba-4ef7-8403-c3b206176411 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.370589 Aug 24 04:52:36.512553 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 255/522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:36 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:36.668434 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:36.691682 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ed3539eb-728f-46e1-b7ff-29de8c216b5b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.317999 Aug 24 04:52:36.693279 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 268/523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:36 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:36.742773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1e9a0760-6ba7-4cca-88e8-b355862733dd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f60d8f12-01df-4eee-9e78-9cf837f6acd2"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:36.746128 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1e9a0760-6ba7-4cca-88e8-b355862733dd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:36.754165 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1e9a0760-6ba7-4cca-88e8-b355862733dd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.754808 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1e9a0760-6ba7-4cca-88e8-b355862733dd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.755383 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1e9a0760-6ba7-4cca-88e8-b355862733dd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.756086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1e9a0760-6ba7-4cca-88e8-b355862733dd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.756672 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1e9a0760-6ba7-4cca-88e8-b355862733dd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.757242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1e9a0760-6ba7-4cca-88e8-b355862733dd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.824725 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:36.826909 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:36.840612 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.843152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.844278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.846089 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.847236 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.848394 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:37.036054 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:37.047345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:37.049955 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:37.051911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0a3cf6c5-d343-41a8-a650-0494279a8559 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.233084 Aug 24 04:52:37.054094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 269/524] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:36 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:52:37.154174 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:37.156255 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:37.169947 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:37.171665 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:37.172463 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:37.173785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:37.174692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:37.175475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:37.386611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:37.396852 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-95187fc9-e26c-4c6c-b96f-4dad68b67ebc tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.250422 Aug 24 04:52:37.398175 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 270/525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:37 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:37.404745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:37.405512 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:37.412151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:37.412664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:37.413096 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:37.413855 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:37.414395 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:37.414876 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:37.581532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:37.596406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7350e2e4-ddf0-4c5f-a1ad-55544a76d04f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.192524 Aug 24 04:52:37.596406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 271/526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:37 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:37.597715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:37.598365 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:37.606877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:37.607380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:37.607862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:37.609706 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:37.610647 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:37.611550 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:37.827887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:37.840895 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-940c68fc-00b2-4d61-a640-9b2acffa907e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.246742 Aug 24 04:52:37.854034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 272/527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:37 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:37.859625 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:37.860413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:37.870770 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:37.871639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:37.872415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:37.873495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:37.874367 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:37.875118 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:38.057501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:38.067564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-737715f3-2943-4e41-a923-be7f8552db46 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.223845 Aug 24 04:52:38.068678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 273/528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:37 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:38.082988 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:38.084251 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:38.096786 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:38.097746 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:38.098466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:38.099444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:38.100231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:38.101078 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:38.288760 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:38.298853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:38.300448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:38.301652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-27336c46-5b8d-4a6b-bfa4-96927b74f1ed tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.226116 Aug 24 04:52:38.302255 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 274/529] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:38 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:38.422997 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:38.424109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:38.442652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:38.444534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:38.445714 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:38.450473 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:38.452238 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:38.453571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:38.671162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:38.684204 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-fca04fbd-7d07-415f-87f4-43e78a7ac1b9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.267367 Aug 24 04:52:38.686390 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 275/530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:38 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:38.704999 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:38.706200 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:38.715247 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:38.715995 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:38.716710 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:38.717560 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:38.718173 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:38.718703 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:38.889922 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:38.900569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3dad0e15-d010-4dd2-8e77-ad731ed15e94 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.212223 Aug 24 04:52:38.918837 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 276/531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:38 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:38.928163 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:38.929144 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:38.940109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:38.940940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:38.941687 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:38.943864 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:38.944726 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:38.945453 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:39.140564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:39.156496 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d7886a48-387f-451c-b8ce-cd4fc4e8af57 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.235444 Aug 24 04:52:39.157549 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 277/532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:38 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:39.168541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:39.172392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:39.185713 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:39.186559 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:39.187353 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:39.188891 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:39.189756 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:39.190579 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:39.408025 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:39.419487 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-af4000de-6a36-4246-b1af-c52dc334f846 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.260178 Aug 24 04:52:39.420516 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 278/533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:39 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:39.433343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:39.438894 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:39.445471 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:39.445962 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:39.446653 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:39.447906 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:39.448361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:39.448774 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:39.683905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:39.694867 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:39.696438 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:39.699091 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ec96658c-7c27-4fdc-8d3a-a30675acff6d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.273283 Aug 24 04:52:39.699948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 279/534] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:39 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:39.712440 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:39.714175 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:39.725110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:39.725974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:39.726904 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:39.728155 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:39.729677 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:39.730525 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:39.959987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:39.977948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-afdaff84-eef4-43ad-9408-c13891c11be5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.272685 Aug 24 04:52:39.979894 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 280/535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:39 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:39.993183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:39.993183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:40.000723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:40.001481 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:40.001481 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:40.003718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:40.004535 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:40.005308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:40.224440 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:40.228956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:40.241331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9256d245-9d8e-4058-95c5-14128efb1919 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.259598 Aug 24 04:52:40.242416 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 281/536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:39 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:40.251346 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:40.252509 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:40.268420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:40.280372 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:40.281267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:40.282123 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:40.284501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:40.285388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:40.286193 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:40.510245 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:40.518310 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-af23fc27-fdbf-4095-b05b-da08e31b8661 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.274408 Aug 24 04:52:40.518911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 282/537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:40 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:40.524213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:40.524820 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:40.532581 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:40.533087 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:40.533521 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:40.534286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:40.534782 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:40.535212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:40.726999 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:40.753540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7863ec9f-3418-400a-9f2c-d1413480ecb7 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.233145 Aug 24 04:52:40.766475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 283/538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:40 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:40.766475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:40.766475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:40.776853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:40.777395 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:40.777796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:40.778605 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:40.779087 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:40.779588 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:40.978615 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:40.991849 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:40.995514 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:40.997640 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-49258f32-ca34-4a9e-90a0-60ce997b024d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.241437 Aug 24 04:52:40.999274 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 284/539] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:40 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:41.007109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:41.008161 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:41.018369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:41.018981 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:41.019550 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:41.021070 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:41.021915 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:41.022692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:41.241210 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:41.262764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-133d20f9-085f-49dc-a221-9032cb107d47 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.261573 Aug 24 04:52:41.265277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 285/540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:40 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:41.278797 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:41.279804 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:41.289479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:41.290595 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:41.291415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:41.292746 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:41.293620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:41.294451 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:41.512886 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:41.523825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e5220de5-189d-4c31-a64e-d9b421b799f2 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.253282 Aug 24 04:52:41.524415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 286/541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:41 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:41.544915 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:41.545734 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:41.554619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:41.554619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:41.555057 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:41.556036 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:41.557187 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:41.558100 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:41.744400 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:41.753536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b84edb0d-4143-4e4c-a199-bb8bde561b30 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.213346 Aug 24 04:52:41.754334 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 287/542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:41 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:41.797523 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:41.798094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:41.809506 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:41.810600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:41.811298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:41.812111 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:41.812640 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:41.813129 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:42.094860 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:42.108312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-17978e29-f3ad-4448-b12f-2709a7c43f2b tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.314705 Aug 24 04:52:42.121115 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 288/543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:41 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:42.131399 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:42.132548 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:42.146501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:42.147235 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:42.147896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:42.149063 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:42.149849 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:42.151269 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:42.349312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:42.359485 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:42.361317 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:42.362572 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-79fdc88e-ca85-4c66-82ba-2f3705bed11a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.239648 Aug 24 04:52:42.380846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 289/544] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:42 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:42.380846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:42.380846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:42.392884 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:42.393773 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:42.394566 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:42.398373 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:42.398968 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:42.399428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:42.614119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:42.628634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ec406e2e-e0ff-495c-be0e-dc121423981a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.263608 Aug 24 04:52:42.629559 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 290/545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:42 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:42.642048 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:42.642048 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:42.646509 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:42.647230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:42.647941 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:42.648906 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:42.649595 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:42.650212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:42.821238 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:42.845581 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-518ed03a-b063-4c4f-9682-f2e34d0ecd6c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.214420 Aug 24 04:52:42.846901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 291/546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:42 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:42.852290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:42.853731 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:42.860503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:42.861153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:42.861713 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:42.863061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:42.863675 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:42.864281 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:43.065848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:43.079387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-dd8f7024-29f4-42e5-aba3-8d511cf13e49 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.230420 Aug 24 04:52:43.080758 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 292/547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:42 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:43.141680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:43.144019 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:43.153830 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:43.154961 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:43.155851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:43.156998 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:43.157703 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:43.158408 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:43.354324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:43.375832 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a0f82c09-a822-47ed-9469-7599b9d4e18e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.238348 Aug 24 04:52:43.380178 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 293/548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:43 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:43.415418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:43.416976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:43.430921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:43.432731 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:43.433266 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:43.435236 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:43.436148 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:43.437068 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:43.705016 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:43.723037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:43.726543 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:43.729604 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-27d488af-e3a3-4683-beef-a826a9b698db tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.321643 Aug 24 04:52:43.731123 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 294/549] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:43 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:52:43.741724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:43.743200 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:43.756432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:43.757439 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:43.759622 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:43.761225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:43.762251 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:43.763252 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:43.992222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:44.008392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-140f9f09-8e03-4077-aa36-3a9cff77459c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.275160 Aug 24 04:52:44.010035 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 295/550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:43 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:44.018450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:44.019541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:44.038538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.039389 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.040333 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:44.042242 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.042899 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.043592 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:44.252794 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:44.266357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a234c24c-0b51-4844-97d1-441fa5ef511c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.254483 Aug 24 04:52:44.267524 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 296/551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:44 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:44.276421 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:44.277503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:44.287361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.287859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.288295 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:44.289003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.289467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.290066 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:44.320890 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:44.508650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:44.518354 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e29ba132-4d9c-43a5-99c7-ded8666fa14e tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.249415 Aug 24 04:52:44.519729 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 297/552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:44 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:44.524551 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-892b9881-736c-44e6-8ca7-5d113c0daec7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:44.525296 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-892b9881-736c-44e6-8ca7-5d113c0daec7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:44.532682 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892b9881-736c-44e6-8ca7-5d113c0daec7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.533185 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892b9881-736c-44e6-8ca7-5d113c0daec7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.533709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892b9881-736c-44e6-8ca7-5d113c0daec7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:44.534400 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892b9881-736c-44e6-8ca7-5d113c0daec7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.534864 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892b9881-736c-44e6-8ca7-5d113c0daec7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.535478 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892b9881-736c-44e6-8ca7-5d113c0daec7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:44.559177 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:44.570895 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-892b9881-736c-44e6-8ca7-5d113c0daec7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6/ips" status: 200 len: 150 microversion: 2.1 time: 0.050455 Aug 24 04:52:44.571496 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 298/553] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:52:44 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:44.577215 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:44.577825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:44.586050 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.586786 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.587244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:44.588338 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.588828 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.589266 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:44.836983 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:44.856684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f2a593ee-2073-46c5-9ced-b90d5d57a186 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.282237 Aug 24 04:52:44.857786 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 299/554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:44 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:44.867072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b0871e0-c3bf-45f6-bd6b-12e04dc33b83"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:44.873628 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:44.885096 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.886186 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.887095 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:44.888453 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:44.889385 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:44.890260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.029032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Invalid volume: volume 7b0871e0-c3bf-45f6-bd6b-12e04dc33b83 is already attached to instances: f79fe8ef-51d0-4ca2-9e41-940ee142b819 Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: POST /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6/os-volume_attachments HTTP/1.1 Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 74 Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:52:45.034877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {"volumeAttachment": {"volumeId": "7b0871e0-c3bf-45f6-bd6b-12e04dc33b83"}} Aug 24 04:52:45.036375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Invalid volume: volume 7b0871e0-c3bf-45f6-bd6b-12e04dc33b83 is already attached to instances: f79fe8ef-51d0-4ca2-9e41-940ee142b819 Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'server_id': '4b427776-20b2-4c84-bf77-7049937303f6', 'body': {'volumeAttachment': {'volumeId': '7b0871e0-c3bf-45f6-bd6b-12e04dc33b83'}}} Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7b0871e0-c3bf-45f6-bd6b-12e04dc33b83 is already attached to instances: f79fe8ef-51d0-4ca2-9e41-940ee142b819 Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:45.037227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7b0871e0-c3bf-45f6-bd6b-12e04dc33b83 is already attached to instances: f79fe8ef-51d0-4ca2-9e41-940ee142b819 Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:45.038691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:52:45.040027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:52:45.040027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:52:45.040027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:52:45.040027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7b0871e0-c3bf-45f6-bd6b-12e04dc33b83 is already attached to instances: f79fe8ef-51d0-4ca2-9e41-940ee142b819 Aug 24 04:52:45.040027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:45.040027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 400 to user: Invalid volume: volume 7b0871e0-c3bf-45f6-bd6b-12e04dc33b83 is already attached to instances: f79fe8ef-51d0-4ca2-9e41-940ee142b819 {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:52:45.040027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b70206ba-264b-46dc-93b8-7e1e395e5c51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.178067 Aug 24 04:52:45.040027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 300/555] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:52:44 2022] POST /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6/os-volume_attachments => generated 174 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:52:45.044761 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:45.045484 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:45.053945 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.054482 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.054928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.055765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.056728 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.058195 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.219168 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:45.230213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:45.231825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:45.233153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-daee21c3-a2f7-4f7b-a737-2babac03f1bf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.193619 Aug 24 04:52:45.233793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 301/556] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:45 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:45.240320 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:45.241081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:45.256821 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.257920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.258420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.260636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.261419 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.262064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.492078 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:45.504478 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d0757ffb-2531-4844-adbf-37f78e90a1a5 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.267302 Aug 24 04:52:45.505488 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 302/557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:45 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:45.514569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:45.515540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:45.529050 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.529887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.530675 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.531601 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.532311 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.532544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.580852 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:52:45.683022 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0c25cb33-aa21-43b4-9ee2-2f02fbc23a2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 204 len: 0 microversion: 2.1 time: 0.175654 Aug 24 04:52:45.683545 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 303/558] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:52:45 2022] DELETE /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:52:45.689014 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:45.689725 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:45.696297 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.696833 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.697954 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.698769 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.699275 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.699710 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.853634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:45.863989 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-67b0914c-fa1f-47c6-8996-3e2b968ba559 tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.179208 Aug 24 04:52:45.864655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 304/559] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:45 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:45.873934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:45.875127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:45.887251 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.888109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.888897 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:45.892572 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:45.892572 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:45.892572 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.061526 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:46.070440 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-bfb51c95-945c-4ad8-bf39-7f6cec9e9af2 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1318 microversion: 2.1 time: 0.204319 Aug 24 04:52:46.071038 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 305/560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:45 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:46.079417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:46.080227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:46.088658 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.089426 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.089872 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.090650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.091236 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.091594 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.266235 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:46.277245 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c21b3b91-0579-4296-8985-acd05df92536 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1682 microversion: 2.1 time: 0.204073 Aug 24 04:52:46.277245 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 306/561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:46 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:46.282360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:46.282977 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:46.289538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.290254 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.290546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.291926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.292446 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.292866 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.452416 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:46.460670 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a16336de-8c10-4bcf-953e-8506481e9b91 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1266 microversion: 2.1 time: 0.182324 Aug 24 04:52:46.461258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 307/562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:46 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:46.466296 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:46.466766 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:46.487779 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.488265 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.488738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.489517 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.489969 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.490428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.639051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:46.648821 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:46.651501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:46.652702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-61eac20d-a35f-406d-8ed4-e65ffff33abb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.190510 Aug 24 04:52:46.653283 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 308/563] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:46 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:46.658043 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:46.658646 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:46.666352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.667321 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.667994 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.669009 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.669732 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.670264 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.751550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:46.818520 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:46.826999 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-caf0e1db-a0ba-4b61-8eb7-74b05e72cdb1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1677 microversion: 2.1 time: 0.172629 Aug 24 04:52:46.827590 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 309/564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:46 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:46.864440 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:46.900430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:46.901127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:46.908542 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.909235 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.909737 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:46.910765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:46.911766 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:46.912429 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:47.106231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:47.115599 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-483b1b83-e7d1-43e6-983d-8d9eefa9db1f tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.220059 Aug 24 04:52:47.116354 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 310/565] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:46 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:47.123279 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:47.124003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:47.130959 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:47.131543 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:47.132028 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:47.133024 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:47.133531 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:47.134453 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:47.298995 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:47.310239 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-cfa19601-cc82-46c8-94e4-2238ab6b4ee7 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1507 microversion: 2.1 time: 0.192672 Aug 24 04:52:47.310841 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 311/566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:47 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:47.315679 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:47.316293 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:47.324135 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:47.324787 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:47.325409 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:47.326302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:47.326913 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:47.327445 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:47.503343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:47.513256 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-62351e01-d4e1-4aaa-bee7-f905738c56e8 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1682 microversion: 2.1 time: 0.201288 Aug 24 04:52:47.513863 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 312/567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:47 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:47.521220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4eb8ccd0-3488-481b-80e7-664738660a65 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7234557a-0f94-4364-a999-4da0ddf9d04d", "device": "/dev/sdb"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:47.527149 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4eb8ccd0-3488-481b-80e7-664738660a65 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:47.535829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb8ccd0-3488-481b-80e7-664738660a65 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:47.536352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb8ccd0-3488-481b-80e7-664738660a65 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:47.536889 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb8ccd0-3488-481b-80e7-664738660a65 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:47.537628 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb8ccd0-3488-481b-80e7-664738660a65 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:47.538118 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb8ccd0-3488-481b-80e7-664738660a65 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:47.538552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb8ccd0-3488-481b-80e7-664738660a65 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:47.646246 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:51.142155 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1e9a0760-6ba7-4cca-88e8-b355862733dd tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "POST /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.403385 Aug 24 04:52:51.142994 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 256/568] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:52:36 2022] POST /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments => generated 194 bytes in 14405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:51.148692 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:51.149397 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:51.157028 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.157530 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.158188 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.158720 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.159176 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.159599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.351751 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:51.360612 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1ae45318-acb0-4ea6-af4c-aa64e21d3837 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1452 microversion: 2.1 time: 0.216381 Aug 24 04:52:51.361213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 257/569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:51 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1452 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:51.366442 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:51.367111 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:51.374216 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.374704 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.375140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.375852 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.376364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.376783 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.560055 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:51.589237 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:51.594715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:51.598600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-562df81e-e7b2-4c8c-ba3c-2766fa228cec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.235208 Aug 24 04:52:51.610827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 258/570] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:51 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:51.625361 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:51.626726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:51.637875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.638687 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.639394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.640655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.641473 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.642270 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.775930 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4eb8ccd0-3488-481b-80e7-664738660a65 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "POST /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.259731 Aug 24 04:52:51.777853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 313/571] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:52:47 2022] POST /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2/os-volume_attachments => generated 194 bytes in 4263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:51.792184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:51.793792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:51.810553 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.812012 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.813751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.815850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.818449 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.819519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.876000 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:51.889820 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a3c7f913-b687-44ff-8a3c-6be0f24105a4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1654 microversion: 2.1 time: 0.277707 Aug 24 04:52:51.890814 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 259/572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:51 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1654 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:51.917209 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:51.917930 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:51.927647 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.929171 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.929171 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.930414 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.931400 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.932043 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.047145 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02367d75d65646f595823dbea8ab8221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd04d25b96334e8982b71c0a5c1ee50b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:52.058954 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4b06e8fc-1932-4714-84a4-60264f3d665c tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 200 len: 1469 microversion: 2.1 time: 0.278069 Aug 24 04:52:52.059848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 314/573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:51 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:52.065884 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:52.066538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:52.074141 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.074804 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.075259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.075992 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.076452 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.076878 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.163136 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:52.203695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f6e3f24a-0f40-45fe-a442-7c16df44e1ea tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1682 microversion: 2.1 time: 0.301213 Aug 24 04:52:52.205821 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 260/574] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:51 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1682 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:52.217465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-105eb8e4-a67c-4b1f-92b2-5665cf6d904d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:52.237858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-105eb8e4-a67c-4b1f-92b2-5665cf6d904d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.238881 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-105eb8e4-a67c-4b1f-92b2-5665cf6d904d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.241659 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-105eb8e4-a67c-4b1f-92b2-5665cf6d904d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.345004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-105eb8e4-a67c-4b1f-92b2-5665cf6d904d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Going to try to start instance {{(pid=127416) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 04:52:52.421098 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:52.456379 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2a0c08a4-0774-4116-a364-007d107b4435 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1452 microversion: 2.1 time: 0.393628 Aug 24 04:52:52.459086 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 315/575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:52 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1452 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:52.474797 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-fcb94fb6-e4b9-46dc-a215-b60fc9b644b7 req-412864d6-9ebc-4d40-a95f-5e253c117143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4327844a-a418-4575-85e9-f50eba8c41d9", "name": "network-vif-deleted", "tag": "ebf9f963-0b36-489c-9bb2-41ef21b12c4e"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:52.519127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-fcb94fb6-e4b9-46dc-a215-b60fc9b644b7 req-412864d6-9ebc-4d40-a95f-5e253c117143 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.531730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-fcb94fb6-e4b9-46dc-a215-b60fc9b644b7 req-412864d6-9ebc-4d40-a95f-5e253c117143 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.532980 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-fcb94fb6-e4b9-46dc-a215-b60fc9b644b7 req-412864d6-9ebc-4d40-a95f-5e253c117143 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.542508 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-105eb8e4-a67c-4b1f-92b2-5665cf6d904d tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/action" status: 202 len: 0 microversion: 2.1 time: 0.329390 Aug 24 04:52:52.550494 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 261/576] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:52:52 2022] POST /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:52:52.585183 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:52.586591 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:52.629312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-fcb94fb6-e4b9-46dc-a215-b60fc9b644b7 req-412864d6-9ebc-4d40-a95f-5e253c117143 service nova] Creating event network-vif-deleted:ebf9f963-0b36-489c-9bb2-41ef21b12c4e for instance 4327844a-a418-4575-85e9-f50eba8c41d9 on hv-cinder-85426 Aug 24 04:52:52.639140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.640149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.642763 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.644209 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.645089 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.651378 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.666040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-fcb94fb6-e4b9-46dc-a215-b60fc9b644b7 req-412864d6-9ebc-4d40-a95f-5e253c117143 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195050 Aug 24 04:52:52.668140 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 316/577] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:52.683058 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:52.706209 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:52.731263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.735266 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.739145 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.741087 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.742922 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.745025 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:53.359700 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:53.361487 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:53.378053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b1d9a1dd-4c63-4dd8-a492-f78987fa7842 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1663 microversion: 2.1 time: 0.817878 Aug 24 04:52:53.380526 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 262/578] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:52 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1663 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:53.380810 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:53.382547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:53.384818 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-11f43e40-b73f-4f30-a83f-c26c811c13fb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.713870 Aug 24 04:52:53.385830 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 317/579] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:52 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:53.391753 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-56839f96-6d08-4b4d-9db0-775c6db553ba req-4139346d-6ac0-4fdb-ae32-59dbd7e9e917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b427776-20b2-4c84-bf77-7049937303f6", "name": "network-vif-unplugged", "status": "completed", "tag": "d5d861d6-908c-463a-b9e9-82677b7a60f7"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:53.401960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:53.402614 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] [instance: 4327844a-a418-4575-85e9-f50eba8c41d9] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:53.409114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:53.409606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:53.410063 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:53.418608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:53.419815 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:53.420158 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:53.448355 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] HTTP exception thrown: Instance 4327844a-a418-4575-85e9-f50eba8c41d9 could not be found. Aug 24 04:52:53.451605 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-56839f96-6d08-4b4d-9db0-775c6db553ba req-4139346d-6ac0-4fdb-ae32-59dbd7e9e917 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:53.454704 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-56839f96-6d08-4b4d-9db0-775c6db553ba req-4139346d-6ac0-4fdb-ae32-59dbd7e9e917 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:53.455600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-56839f96-6d08-4b4d-9db0-775c6db553ba req-4139346d-6ac0-4fdb-ae32-59dbd7e9e917 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Request method failure captured: Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 HTTP/1.1 Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa5l_tu5NX19f72qrYvK9nYNMOsR4WYESsfxyZm6FMu7RAgLLf30WtRbyzBOZXpsDIQHVMtEvtdHxR86-dOZhk1tWdKR1qIlAh8akhvFYAVSG2EwwW0xoDAL_nFQK3n3oPAC-rG7wgSZr0upugUiGacjoCa74nkGZPRA7gc397BldKk Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: dd04d25b96334e8982b71c0a5c1ee50b Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesNegativeTest-1020240765 Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:52:53.458691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd04d25b96334e8982b71c0a5c1ee50b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd04d25b96334e8982b71c0a5c1ee50b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd04d25b96334e8982b71c0a5c1ee50b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd04d25b96334e8982b71c0a5c1ee50b"}]}] Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesNegativeTest-1020240765 Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: dd04d25b96334e8982b71c0a5c1ee50b Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesNegativeTest-1020240765 Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesNegativeTest-1020240765-project Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 02367d75d65646f595823dbea8ab8221 Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesNegativeTest-1020240765-project Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 4327844a-a418-4575-85e9-f50eba8c41d9 could not be found. Aug 24 04:52:53.461211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '4327844a-a418-4575-85e9-f50eba8c41d9'} Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4327844a-a418-4575-85e9-f50eba8c41d9 could not be found. Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:52:53.471921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4327844a-a418-4575-85e9-f50eba8c41d9 could not be found. Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4327844a-a418-4575-85e9-f50eba8c41d9 could not be found. Aug 24 04:52:53.476397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:52:53.484564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] Returning 404 to user: Instance 4327844a-a418-4575-85e9-f50eba8c41d9 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:52:53.484564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-163ef562-9506-42ad-a67e-61eb3695363e tempest-VolumesNegativeTest-1020240765 tempest-VolumesNegativeTest-1020240765-project] 10.222.0.60 "GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9" status: 404 len: 111 microversion: 2.1 time: 0.074029 Aug 24 04:52:53.484564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 318/580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:53 2022] GET /compute/v2.1/servers/4327844a-a418-4575-85e9-f50eba8c41d9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:52:53.484564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:53.484564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:53.505671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:53.506193 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:53.506827 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:53.507726 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:53.518851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:53.519797 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:53.535182 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-56839f96-6d08-4b4d-9db0-775c6db553ba req-4139346d-6ac0-4fdb-ae32-59dbd7e9e917 service nova] Creating event network-vif-unplugged:d5d861d6-908c-463a-b9e9-82677b7a60f7 for instance 4b427776-20b2-4c84-bf77-7049937303f6 on hv-cinder-85426 Aug 24 04:52:53.559268 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-56839f96-6d08-4b4d-9db0-775c6db553ba req-4139346d-6ac0-4fdb-ae32-59dbd7e9e917 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.176812 Aug 24 04:52:53.559924 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 263/581] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:53.965434 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:53.980481 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8b999e40-a9fd-4733-b2ca-e6d0efefa673 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1682 microversion: 2.1 time: 0.518342 Aug 24 04:52:53.994912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 319/582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:53 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1682 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:54.418178 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:54.424528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:54.425913 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:54.429807 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:54.442725 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:54.443243 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:54.443687 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:54.448429 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:54.450495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:54.451342 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:54.452169 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:54.453030 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:54.455779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:54.456806 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:54.458590 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:54.459165 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:55.266324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:55.280310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:55.282967 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:55.284761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-6f8853f4-9950-4590-82d2-2f83fb7d1e0e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.873116 Aug 24 04:52:55.286095 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 264/583] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:54 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:55.294487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:55.295419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:55.303673 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:55.304802 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:55.305889 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:55.306945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:55.307594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:55.308331 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:55.362879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:55.382078 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-22d8d6d8-0463-4a9a-abb6-6157c1813085 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1663 microversion: 2.1 time: 0.961335 Aug 24 04:52:55.391024 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 320/584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:54 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1663 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:55.434437 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:55.445576 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-dd8a42f2-6595-4242-b1cd-2e4fb119ec98 req-f10fa826-8718-4205-a2fc-e24885e8bbef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b427776-20b2-4c84-bf77-7049937303f6", "name": "network-vif-deleted", "tag": "d5d861d6-908c-463a-b9e9-82677b7a60f7"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:55.464857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d26413f1-1015-4a0c-97e9-22e41c6d96e5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 200 len: 1614 microversion: 2.1 time: 0.176713 Aug 24 04:52:55.467855 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 265/585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:55 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 1614 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:55.484148 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-dd8a42f2-6595-4242-b1cd-2e4fb119ec98 req-f10fa826-8718-4205-a2fc-e24885e8bbef service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:55.484962 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-dd8a42f2-6595-4242-b1cd-2e4fb119ec98 req-f10fa826-8718-4205-a2fc-e24885e8bbef service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:55.486641 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-dd8a42f2-6595-4242-b1cd-2e4fb119ec98 req-f10fa826-8718-4205-a2fc-e24885e8bbef service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:55.513372 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-dd8a42f2-6595-4242-b1cd-2e4fb119ec98 req-f10fa826-8718-4205-a2fc-e24885e8bbef service nova] Creating event network-vif-deleted:d5d861d6-908c-463a-b9e9-82677b7a60f7 for instance 4b427776-20b2-4c84-bf77-7049937303f6 on hv-cinder-85426 Aug 24 04:52:55.538126 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-dd8a42f2-6595-4242-b1cd-2e4fb119ec98 req-f10fa826-8718-4205-a2fc-e24885e8bbef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095783 Aug 24 04:52:55.544958 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 321/586] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:52:56.327897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:56.328499 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:56.345853 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:56.346426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:56.346886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:56.347683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:56.356267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:56.356931 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:56.430387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:56.432134 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:56.450742 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:56.451323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:56.451699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:56.454933 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:56.457557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:56.458315 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:56.887599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:56.908565 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:56.912239 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:56.918150 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-517ede44-60ba-4784-90fb-6c92769c204e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.595132 Aug 24 04:52:56.925569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:56.937666 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 266/587] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:56 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:56.942423 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2a64b653-d56c-458e-b703-bd81ff7ddc16 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1663 microversion: 2.1 time: 0.516684 Aug 24 04:52:56.944369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 322/588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:56 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1663 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:56.954818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:56.956185 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:56.964449 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-51b17803-a73b-42e5-81d4-29dcc7c2746c req-62190cfd-0bce-4163-ae39-d9b2aa35b84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57311393-dc24-4693-a167-bafcb80a8c46", "tag": "285aec92-b5fd-4f9f-bcd0-e92475d6d6bc"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:56.988468 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:56.989799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:56.992433 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:56.993790 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:56.998453 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:57.002110 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:57.004519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-51b17803-a73b-42e5-81d4-29dcc7c2746c req-62190cfd-0bce-4163-ae39-d9b2aa35b84e service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:57.005873 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-51b17803-a73b-42e5-81d4-29dcc7c2746c req-62190cfd-0bce-4163-ae39-d9b2aa35b84e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:57.007140 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-51b17803-a73b-42e5-81d4-29dcc7c2746c req-62190cfd-0bce-4163-ae39-d9b2aa35b84e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:57.036211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-51b17803-a73b-42e5-81d4-29dcc7c2746c req-62190cfd-0bce-4163-ae39-d9b2aa35b84e service nova] Creating event network-changed:285aec92-b5fd-4f9f-bcd0-e92475d6d6bc for instance 57311393-dc24-4693-a167-bafcb80a8c46 on hv-cinder-85426 Aug 24 04:52:57.047081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-51b17803-a73b-42e5-81d4-29dcc7c2746c req-62190cfd-0bce-4163-ae39-d9b2aa35b84e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100697 Aug 24 04:52:57.051399 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 323/589] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:57.063345 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 HTTP/1.1 Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:52:57.067637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:52:57.070683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '4b427776-20b2-4c84-bf77-7049937303f6'} Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:52:57.072784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:52:57.075485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:52:57.078983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:52:57.078983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-83aeeb47-7e9f-41d9-a973-c37804d0137f tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 404 len: 111 microversion: 2.1 time: 0.130181 Aug 24 04:52:57.078983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 267/590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:56 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:52:57.084640 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c2b41541-413f-443e-a9af-aac8599f2eed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '.version_select at 0x7fb0503ab5e0>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:57.122911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c2b41541-413f-443e-a9af-aac8599f2eed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755331327" status: 202 len: 0 microversion: 2.1 time: 0.043970 Aug 24 04:52:57.139785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 324/591] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Aug 24 04:52:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755331327 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:52:57.980580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:57.981728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:57.992777 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:57.998780 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:58.011104 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:58.012219 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:58.016824 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:58.018976 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:58.021515 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:58.024894 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:58.027799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:58.029167 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:58.030856 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:58.034759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:58.037613 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:58.042396 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:58.516887 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:58.535335 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8ad9f17a-9e20-474c-9f1e-83a4759276a0 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1667 microversion: 2.1 time: 0.562413 Aug 24 04:52:58.537247 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 268/592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:57 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1667 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:58.559938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:58.584183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:58.584183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:58.584183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9e628a2a-3d0c-4649-891d-e5dc32c02932 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.605233 Aug 24 04:52:58.603445 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 325/593] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:57 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:58.980750 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:58.980750 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:58.992662 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:58.993329 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:58.993897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:58.994601 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:58.995180 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:58.995605 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:59.176310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lazy-loading 'services' on Instance uuid f79fe8ef-51d0-4ca2-9e41-940ee142b819 {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:52:59.348444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5fe9a03c-8647-4bcd-b456-23168362c729 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments/7b0871e0-c3bf-45f6-bd6b-12e04dc33b83" status: 202 len: 0 microversion: 2.1 time: 0.374182 Aug 24 04:52:59.349820 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 269/594] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:52:58 2022] DELETE /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments/7b0871e0-c3bf-45f6-bd6b-12e04dc33b83 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:52:59.365312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-42d73f5b-c20c-486a-8ca5-0ae2bcb1b18c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:59.370811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-42d73f5b-c20c-486a-8ca5-0ae2bcb1b18c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:59.383125 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-42d73f5b-c20c-486a-8ca5-0ae2bcb1b18c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:59.384986 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-42d73f5b-c20c-486a-8ca5-0ae2bcb1b18c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:59.385629 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-42d73f5b-c20c-486a-8ca5-0ae2bcb1b18c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:59.386964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-42d73f5b-c20c-486a-8ca5-0ae2bcb1b18c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:59.387910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-42d73f5b-c20c-486a-8ca5-0ae2bcb1b18c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:59.388802 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-42d73f5b-c20c-486a-8ca5-0ae2bcb1b18c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:59.440202 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-42d73f5b-c20c-486a-8ca5-0ae2bcb1b18c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082744 Aug 24 04:52:59.440811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 326/595] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:52:59 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:59.606364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:59.606995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:59.614516 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:59.615041 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:59.616910 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:59.617710 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:59.618829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:59.619266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:59.830224 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:59.845100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:59.847236 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:59.848757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bb6095a9-1ec1-4e53-b4b9-57221c51f84c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.247609 Aug 24 04:52:59.860044 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 270/596] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:52:59 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:59.967875 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-83c1d918-51b6-4f31-abff-9d71df2957a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e290423-7630-4511-92b1-f0db5d9c8baf"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:59.975263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-83c1d918-51b6-4f31-abff-9d71df2957a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:59.989299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-83c1d918-51b6-4f31-abff-9d71df2957a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:59.989806 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-83c1d918-51b6-4f31-abff-9d71df2957a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:59.990361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-83c1d918-51b6-4f31-abff-9d71df2957a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:59.991216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-83c1d918-51b6-4f31-abff-9d71df2957a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:59.991619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-83c1d918-51b6-4f31-abff-9d71df2957a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:59.992049 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-83c1d918-51b6-4f31-abff-9d71df2957a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:00.454835 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9050c963-e2c6-4c54-a221-51bc920ea008 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:00.457590 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9050c963-e2c6-4c54-a221-51bc920ea008 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:00.483273 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9050c963-e2c6-4c54-a221-51bc920ea008 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:00.484182 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9050c963-e2c6-4c54-a221-51bc920ea008 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:00.484847 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9050c963-e2c6-4c54-a221-51bc920ea008 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:00.498517 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-83c1d918-51b6-4f31-abff-9d71df2957a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543430 Aug 24 04:53:00.501172 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 327/597] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:52:59 2022] POST /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:00.502272 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9050c963-e2c6-4c54-a221-51bc920ea008 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:00.503071 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9050c963-e2c6-4c54-a221-51bc920ea008 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:00.504576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9050c963-e2c6-4c54-a221-51bc920ea008 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:00.600025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:00.612249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9050c963-e2c6-4c54-a221-51bc920ea008 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161684 Aug 24 04:53:00.613099 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 271/598] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:00 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:00.883219 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:00.884980 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:00.888837 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:00.892912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:00.893425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:00.893872 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:00.894633 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:00.895343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:00.896173 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:00.905688 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:00.906925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:00.919484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:00.920022 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:00.920465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:00.921199 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:00.921655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:00.930097 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:01.203426 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:01.214664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:01.220271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:01.223469 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:01.225849 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4eb5fbcd-fa36-4b0c-bf84-adb325663303 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.348181 Aug 24 04:53:01.227352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 328/599] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:53:00 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:01.229704 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3182b641-6ec7-416c-9d83-5048846b518f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1593 microversion: 2.1 time: 0.328557 Aug 24 04:53:01.234221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 272/600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:00 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1593 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:01.631933 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f7c9d1c9-b03c-4537-882f-d7beeda55526 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:01.636510 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f7c9d1c9-b03c-4537-882f-d7beeda55526 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:01.648267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f7c9d1c9-b03c-4537-882f-d7beeda55526 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:01.649892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f7c9d1c9-b03c-4537-882f-d7beeda55526 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:01.651852 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f7c9d1c9-b03c-4537-882f-d7beeda55526 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:01.653513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f7c9d1c9-b03c-4537-882f-d7beeda55526 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:01.655148 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f7c9d1c9-b03c-4537-882f-d7beeda55526 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:01.656267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f7c9d1c9-b03c-4537-882f-d7beeda55526 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:01.734255 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f7c9d1c9-b03c-4537-882f-d7beeda55526 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111794 Aug 24 04:53:01.743920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 329/601] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:01 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:02.252440 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:02.253108 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:02.260641 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:02.261126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:02.261565 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:02.262311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:02.262771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:02.263350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:02.555885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:02.574688 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:02.576793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:02.578132 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a6582400-a6ca-4f7a-8c24-2eb849c74998 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.330317 Aug 24 04:53:02.578787 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 273/602] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:53:02 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:02.648801 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-47f116dd-fadc-4d3f-ab93-b744168017ad req-a7f8d2a5-5009-48f2-9a52-9ce95a85e623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eeaea49-9c15-4e0a-a446-98d3191293c8", "name": "network-vif-plugged", "status": "completed", "tag": "6bd895e9-3f00-4d89-aab3-7b4bbc97e62d"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:02.662917 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-47f116dd-fadc-4d3f-ab93-b744168017ad req-a7f8d2a5-5009-48f2-9a52-9ce95a85e623 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:02.663616 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-47f116dd-fadc-4d3f-ab93-b744168017ad req-a7f8d2a5-5009-48f2-9a52-9ce95a85e623 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:02.664213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-47f116dd-fadc-4d3f-ab93-b744168017ad req-a7f8d2a5-5009-48f2-9a52-9ce95a85e623 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:02.682684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-47f116dd-fadc-4d3f-ab93-b744168017ad req-a7f8d2a5-5009-48f2-9a52-9ce95a85e623 service nova] Creating event network-vif-plugged:6bd895e9-3f00-4d89-aab3-7b4bbc97e62d for instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 on hv-cinder-85426 Aug 24 04:53:02.689288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-47f116dd-fadc-4d3f-ab93-b744168017ad req-a7f8d2a5-5009-48f2-9a52-9ce95a85e623 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045622 Aug 24 04:53:02.690602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 330/603] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:53:02.750717 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-636ea125-2253-494d-b792-44bd8346ccd2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:02.753108 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-636ea125-2253-494d-b792-44bd8346ccd2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:02.760781 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-636ea125-2253-494d-b792-44bd8346ccd2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:02.761359 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-636ea125-2253-494d-b792-44bd8346ccd2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:02.762116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-636ea125-2253-494d-b792-44bd8346ccd2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:02.763069 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-636ea125-2253-494d-b792-44bd8346ccd2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:02.763593 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-636ea125-2253-494d-b792-44bd8346ccd2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:02.764103 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-636ea125-2253-494d-b792-44bd8346ccd2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:02.800004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-636ea125-2253-494d-b792-44bd8346ccd2 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053227 Aug 24 04:53:02.800651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 274/604] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:02 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:03.619256 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:03.620525 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:03.634303 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:03.637308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:03.638374 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:03.639998 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:03.641181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:03.642335 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:03.733881 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-26c8d4fc-9f50-45df-a295-3693b9a41534 req-053e2622-3ebc-4464-86a8-294556f9575d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02", "tag": "cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:03.760462 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-26c8d4fc-9f50-45df-a295-3693b9a41534 req-053e2622-3ebc-4464-86a8-294556f9575d service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:03.764743 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-26c8d4fc-9f50-45df-a295-3693b9a41534 req-053e2622-3ebc-4464-86a8-294556f9575d service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:03.765614 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-26c8d4fc-9f50-45df-a295-3693b9a41534 req-053e2622-3ebc-4464-86a8-294556f9575d service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:03.800192 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-26c8d4fc-9f50-45df-a295-3693b9a41534 req-053e2622-3ebc-4464-86a8-294556f9575d service nova] Creating event network-changed:cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7 for instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 on hv-cinder-85426 Aug 24 04:53:03.809502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-26c8d4fc-9f50-45df-a295-3693b9a41534 req-053e2622-3ebc-4464-86a8-294556f9575d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079626 Aug 24 04:53:03.810838 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 275/605] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:53:03.818314 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7b7e1c4e-27b9-4960-9afb-526d6acb0c52 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:03.822119 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7b7e1c4e-27b9-4960-9afb-526d6acb0c52 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:03.831138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c4e-27b9-4960-9afb-526d6acb0c52 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:03.831941 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c4e-27b9-4960-9afb-526d6acb0c52 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:03.832674 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c4e-27b9-4960-9afb-526d6acb0c52 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:03.834126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c4e-27b9-4960-9afb-526d6acb0c52 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:03.834912 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c4e-27b9-4960-9afb-526d6acb0c52 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:03.835603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c4e-27b9-4960-9afb-526d6acb0c52 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:03.923690 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7b7e1c4e-27b9-4960-9afb-526d6acb0c52 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108609 Aug 24 04:53:03.924810 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 276/606] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:03 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:04.004788 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:04.032744 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:04.040472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:04.043522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5a30012e-e8e0-49ae-abc2-7bd9ce37322d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.432273 Aug 24 04:53:04.045010 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 331/607] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:53:03 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:04.938861 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3b60a00a-ca03-43ab-b42c-6ea8b239f0be tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:04.942199 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3b60a00a-ca03-43ab-b42c-6ea8b239f0be tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:04.950919 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b60a00a-ca03-43ab-b42c-6ea8b239f0be tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:04.951679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b60a00a-ca03-43ab-b42c-6ea8b239f0be tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:04.952361 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b60a00a-ca03-43ab-b42c-6ea8b239f0be tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:04.953294 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b60a00a-ca03-43ab-b42c-6ea8b239f0be tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:04.953922 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b60a00a-ca03-43ab-b42c-6ea8b239f0be tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:04.954534 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b60a00a-ca03-43ab-b42c-6ea8b239f0be tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:05.050194 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3b60a00a-ca03-43ab-b42c-6ea8b239f0be tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113410 Aug 24 04:53:05.060657 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 277/608] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:04 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:05.081438 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:05.082702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:05.108020 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:05.108887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:05.117100 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:05.118808 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:05.123627 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:05.127324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:05.146347 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:05.497458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:05.516716 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:05.520993 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:05.524137 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-bf87a1c6-7ee1-4cf5-8c0c-8e47087cf041 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1810 microversion: 2.20 time: 0.458041 Aug 24 04:53:05.526285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 332/609] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:53:05 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1810 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:05.616578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-412141473"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:05.618300 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:05.632360 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:05.633878 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:05.635382 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:05.636897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:05.637746 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:05.638740 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:05.821673 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.network.security_group_api [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Adding security group b7a7e7ce-bd7c-4118-9b8a-949a044e0d6f to port cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7 Aug 24 04:53:06.073004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-57f43e09-9087-44e3-b8bc-2a16ebe82be3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:06.077031 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-57f43e09-9087-44e3-b8bc-2a16ebe82be3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:06.091745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-57f43e09-9087-44e3-b8bc-2a16ebe82be3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:06.092810 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-57f43e09-9087-44e3-b8bc-2a16ebe82be3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:06.093439 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-57f43e09-9087-44e3-b8bc-2a16ebe82be3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:06.095112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-57f43e09-9087-44e3-b8bc-2a16ebe82be3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:06.095880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-57f43e09-9087-44e3-b8bc-2a16ebe82be3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:06.096564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-57f43e09-9087-44e3-b8bc-2a16ebe82be3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:06.167986 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-57f43e09-9087-44e3-b8bc-2a16ebe82be3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102880 Aug 24 04:53:06.182544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 333/610] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:06 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:06.431263 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-590bc625-193a-4205-9d06-9524564c339e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "POST /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/action" status: 202 len: 0 microversion: 2.1 time: 0.819942 Aug 24 04:53:06.432461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 278/611] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:53:05 2022] POST /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/action => generated 0 bytes in 825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:53:06.450538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-7336a53b-65c3-47ba-8a0a-582e56cc3bf5 req-6caeb3af-d348-4e1f-aaa1-a787099fee30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02", "tag": "cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:06.457901 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:06.467321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:06.505824 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:06.510047 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-7336a53b-65c3-47ba-8a0a-582e56cc3bf5 req-6caeb3af-d348-4e1f-aaa1-a787099fee30 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:06.511185 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:06.511895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:06.512735 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:06.513669 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-7336a53b-65c3-47ba-8a0a-582e56cc3bf5 req-6caeb3af-d348-4e1f-aaa1-a787099fee30 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:06.514597 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:06.515475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-7336a53b-65c3-47ba-8a0a-582e56cc3bf5 req-6caeb3af-d348-4e1f-aaa1-a787099fee30 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:06.516409 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:06.571139 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-7336a53b-65c3-47ba-8a0a-582e56cc3bf5 req-6caeb3af-d348-4e1f-aaa1-a787099fee30 service nova] Creating event network-changed:cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7 for instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 on hv-cinder-85426 Aug 24 04:53:06.599261 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-7336a53b-65c3-47ba-8a0a-582e56cc3bf5 req-6caeb3af-d348-4e1f-aaa1-a787099fee30 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159159 Aug 24 04:53:06.600424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 334/612] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:53:06.622553 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:06.624217 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:06.638206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:06.639091 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:06.640151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:06.641605 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:06.642307 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:06.643098 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:07.238725 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:07.252770 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-52424e65-8c86-4974-b914-5eab436d7e1b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1758 microversion: 2.1 time: 0.805448 Aug 24 04:53:07.253929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 279/613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:06 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1758 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:07.259658 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-48e7ee5b-42f5-46d4-807b-80a6fa800ecd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:07.262372 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-48e7ee5b-42f5-46d4-807b-80a6fa800ecd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:07.271293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48e7ee5b-42f5-46d4-807b-80a6fa800ecd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:07.272310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48e7ee5b-42f5-46d4-807b-80a6fa800ecd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:07.272975 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48e7ee5b-42f5-46d4-807b-80a6fa800ecd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:07.274897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48e7ee5b-42f5-46d4-807b-80a6fa800ecd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:07.275590 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48e7ee5b-42f5-46d4-807b-80a6fa800ecd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:07.276255 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-48e7ee5b-42f5-46d4-807b-80a6fa800ecd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:07.315546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-48e7ee5b-42f5-46d4-807b-80a6fa800ecd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060349 Aug 24 04:53:07.321053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 280/614] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:07 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:07.366214 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:07.376957 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:07.378758 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:07.380030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-587ba838-9492-4814-bacb-33aa85b5a083 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1797 microversion: 2.20 time: 0.777634 Aug 24 04:53:07.380662 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 335/615] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:53:06 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1797 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:08.328694 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-12ae7c91-b33c-4dda-b714-40a21b34ff0c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:08.331021 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-12ae7c91-b33c-4dda-b714-40a21b34ff0c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:08.338588 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12ae7c91-b33c-4dda-b714-40a21b34ff0c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:08.339078 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12ae7c91-b33c-4dda-b714-40a21b34ff0c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:08.339512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12ae7c91-b33c-4dda-b714-40a21b34ff0c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:08.340229 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12ae7c91-b33c-4dda-b714-40a21b34ff0c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:08.340679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12ae7c91-b33c-4dda-b714-40a21b34ff0c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:08.341097 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12ae7c91-b33c-4dda-b714-40a21b34ff0c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:08.376123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-12ae7c91-b33c-4dda-b714-40a21b34ff0c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051497 Aug 24 04:53:08.376715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 281/616] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:08 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 04:53:08.493260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:08.493901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:08.501149 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:08.501631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:08.502104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:08.502818 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:08.503617 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:08.504058 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:08.532939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:53:08.628790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b8df0487-0340-40f4-9301-078d9c34090e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 204 len: 0 microversion: 2.1 time: 0.142578 Aug 24 04:53:08.629345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 336/617] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:53:08 2022] DELETE /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:53:08.641221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:08.642090 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:08.650942 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:08.651460 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:08.651943 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:08.652695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:08.653150 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:08.653579 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:08.805970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:08.814434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-670a4b01-61b3-4315-b98f-4a2a88e812e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1682 microversion: 2.1 time: 0.179322 Aug 24 04:53:08.815019 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 282/618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:08 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:09.837547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:09.838513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:09.845553 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:09.846120 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:09.846568 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:09.847350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:09.847750 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:09.848212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:10.005899 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:10.019043 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2fc796d4-8284-48b9-afbd-2ddf147ccf51 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1682 microversion: 2.1 time: 0.186768 Aug 24 04:53:10.020523 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 337/619] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:09 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:11.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:11.056979 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:11.064284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:11.064776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:11.065205 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:11.065915 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:11.066398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:11.066833 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:11.234828 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:11.244327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b5921169-0187-4c3f-9773-799ced6e33ed tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1682 microversion: 2.1 time: 0.192125 Aug 24 04:53:11.244917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 283/620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:11 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:12.270225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:12.271049 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:12.278294 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:12.278786 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:12.279220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:12.279962 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:12.280390 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:12.280809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:12.435118 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:12.443422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-cd3de40b-1c18-45fe-9bba-a1d3eab7a2db tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1682 microversion: 2.1 time: 0.177840 Aug 24 04:53:12.444036 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 338/621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:12 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:13.465958 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:13.466672 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:13.475346 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:13.475986 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:13.476710 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:13.478322 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:13.479130 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:13.479885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:13.644294 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:13.653504 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4bcfb943-1595-4743-802a-88363b29343b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1682 microversion: 2.1 time: 0.192082 Aug 24 04:53:13.654041 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 284/622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:13 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:14.680914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:14.682043 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:14.693522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:14.694440 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:14.695688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:14.697213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:14.698076 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:14.698840 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:14.872848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:14.881488 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7021483c-0a02-487f-9988-8a96096b60fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1682 microversion: 2.1 time: 0.208578 Aug 24 04:53:14.882104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 339/623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:14 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:15.909048 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:15.910580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:15.919866 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:15.920679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:15.921603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:15.922335 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:15.922947 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:15.923395 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:16.107320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:16.115802 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d57785d8-1378-4c73-82a3-cfa98aadb15d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1682 microversion: 2.1 time: 0.213154 Aug 24 04:53:16.116387 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 285/624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:15 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:17.137114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:17.137850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:17.145465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:17.145992 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:17.146297 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:17.147187 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:17.147840 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:17.148845 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:17.285328 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:17.296328 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4ec076a8-01db-45f7-b6c8-b524612efe1b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 200 len: 1614 microversion: 2.1 time: 0.163281 Aug 24 04:53:17.297231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 340/625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:17 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 1614 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:17.390415 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-aee86384-a804-4f84-9645-a891285120df req-4e469918-552f-47a4-88cf-ff8ad0f16f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79fe8ef-51d0-4ca2-9e41-940ee142b819", "name": "network-vif-deleted", "tag": "4c78e02d-9548-429c-8228-3b6cbd0d044c"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:17.400620 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=59 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:17.411430 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-aee86384-a804-4f84-9645-a891285120df req-4e469918-552f-47a4-88cf-ff8ad0f16f39 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:17.421861 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-aee86384-a804-4f84-9645-a891285120df req-4e469918-552f-47a4-88cf-ff8ad0f16f39 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:17.422905 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-aee86384-a804-4f84-9645-a891285120df req-4e469918-552f-47a4-88cf-ff8ad0f16f39 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:17.438155 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-aee86384-a804-4f84-9645-a891285120df req-4e469918-552f-47a4-88cf-ff8ad0f16f39 service nova] Creating event network-vif-deleted:4c78e02d-9548-429c-8228-3b6cbd0d044c for instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 on hv-cinder-85426 Aug 24 04:53:17.444514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-aee86384-a804-4f84-9645-a891285120df req-4e469918-552f-47a4-88cf-ff8ad0f16f39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058424 Aug 24 04:53:17.446752 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 286/626] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:18.332386 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:18.333213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:18.340780 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:18.341275 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:18.341773 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:18.342594 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:18.343058 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:18.343485 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:18.363761 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 HTTP/1.1 Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:53:18.365607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:53:18.368220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': 'f79fe8ef-51d0-4ca2-9e41-940ee142b819'} Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:18.369326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:53:18.371042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:18.372688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:18.372688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0459d267-52a6-4d23-8bfa-5e1f0bfc0c2b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 404 len: 111 microversion: 2.1 time: 0.039036 Aug 24 04:53:18.372688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 341/627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:18 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:53:18.378546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-06ce83af-e459-4ab5-9886-ed3fdfca4452 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '.version_select at 0x7fb050982040>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:18.406160 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-06ce83af-e459-4ab5-9886-ed3fdfca4452 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254139989" status: 202 len: 0 microversion: 2.1 time: 0.032962 Aug 24 04:53:18.410398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 287/628] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Aug 24 04:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254139989 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:53:19.226183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ac11ddd1-b96b-488d-82d0-2562fff84be5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: .version_select at 0x7fb05025b700>, body: {"keypair": {"name": "tempest-keypair-472267010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFrwpI/wc36Lv4Cdb4/8BEPEvxlbpUnNhpAauhufZCS16AypyD0H48zUInIlM219QwipaV2VGc6g89ygXUNY65uPmh7B7g2yDCe0u4uu0Ng5fBPSONBfGBhPZYtg5W3UA=="}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:19.242848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-ac11ddd1-b96b-488d-82d0-2562fff84be5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:53:19.247315 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-ac11ddd1-b96b-488d-82d0-2562fff84be5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for user b847f94abee2439fab2f85f48abd7707 and project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:53:19.275826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ac11ddd1-b96b-488d-82d0-2562fff84be5 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053710 Aug 24 04:53:19.276454 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 342/629] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:53:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:53:19.897076 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:19.897704 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:19.905713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:19.906238 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:19.906675 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:19.907407 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:19.907862 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:19.908458 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:20.015231 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lazy-loading 'services' on Instance uuid 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:53:20.107899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-69efedb0-968f-419b-bd64-4cc5e5a2e201 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2/os-volume_attachments/7234557a-0f94-4364-a999-4da0ddf9d04d" status: 202 len: 0 microversion: 2.1 time: 0.214492 Aug 24 04:53:20.108850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 288/630] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:53:19 2022] DELETE /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2/os-volume_attachments/7234557a-0f94-4364-a999-4da0ddf9d04d => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:53:20.719771 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-59832344", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bc1ad55-5d65-47b3-8be9-9d83a75436be"}], "security_groups": [{"name": "tempest-securitygroup--1982239972"}], "key_name": "tempest-keypair-472267010", "user_data": "}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:20.859643 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.network.neutron [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] validate_networks() for [('5bc1ad55-5d65-47b3-8be9-9d83a75436be', None, None, None, None, None)] {{(pid=127415) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:53:21.303993 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Flavor limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:53:21.305071 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Image limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:53:21.305552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Flavor pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:53:21.305969 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Image pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:53:21.306415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:53:21.316162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:21.316645 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:21.317080 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:21.317820 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:21.318332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:21.318758 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:21.338183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:53:21.342886 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for user b847f94abee2439fab2f85f48abd7707 and project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:53:21.356013 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Going to run 1 instances... {{(pid=127415) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:53:21.358304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:53:21.410364 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2ff26271-fc07-4d15-932a-814adaa36ffc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.695282 Aug 24 04:53:21.411086 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 343/631] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:53:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:53:21.423450 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9796d19e-a4d9-47a5-a651-d614da8e6a84 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:21.424158 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9796d19e-a4d9-47a5-a651-d614da8e6a84 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:21.485263 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9796d19e-a4d9-47a5-a651-d614da8e6a84 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:21.497388 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9796d19e-a4d9-47a5-a651-d614da8e6a84 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1239 microversion: 2.1 time: 0.077650 Aug 24 04:53:21.498589 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 289/632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:21 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:22.437098 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:22.439513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:22.448336 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:22.448834 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:22.449284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:22.450045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:22.450558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:22.451003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:22.480084 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lazy-loading 'flavor' on Instance uuid 15409608-f562-4e3c-af4c-e918e3f5921b {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:53:22.520365 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:22.520969 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:22.529548 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:22.530442 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:22.530900 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:22.531645 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:22.532112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:22.532728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:22.614955 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:22.628419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f17be35d-f35d-480f-8f92-b5dfba807a6a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1291 microversion: 2.1 time: 0.111759 Aug 24 04:53:22.629665 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 290/633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:22 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1291 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:22.695417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c53e1f80-4346-4e80-9fe8-b04c95f37261 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/action" status: 200 len: 32 microversion: 2.1 time: 0.261672 Aug 24 04:53:22.696150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 344/634] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:53:22 2022] POST /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:53:22.705797 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:22.706429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:22.712930 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:22.713419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:22.713851 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:22.714598 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:22.715044 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:22.715465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:22.736745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:22.876438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:22.885814 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-37c84bee-91a9-4295-b75d-89f87009727d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.183730 Aug 24 04:53:22.886460 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 291/635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:22 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:23.411518 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:23.412110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:23.418979 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:23.419467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:23.419910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:23.420620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:23.421078 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:23.421503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:23.458179 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:53:23.581158 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f07ff5ce-d901-40ce-b6d1-d7a8c2ad67c1 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 204 len: 0 microversion: 2.1 time: 0.173434 Aug 24 04:53:23.583077 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 345/636] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:53:23 2022] DELETE /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:53:23.596115 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:23.597995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:23.610206 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:23.611006 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:23.611759 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:23.612603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:23.613398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:23.614245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:23.653790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:23.654978 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:23.661061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:23.661793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:23.662444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:23.663972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:23.665109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:23.665551 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:23.682945 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:23.743659 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:23.752545 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-89cab1e8-3d1f-461f-87fa-4dad466d92e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1297 microversion: 2.1 time: 0.103257 Aug 24 04:53:23.753247 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 346/637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:23 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:23.819072 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:23.829841 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-90931786-9a7e-402c-8523-ff96dca78814 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1513 microversion: 2.1 time: 0.238995 Aug 24 04:53:23.831220 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 292/638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:23 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:23.908295 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:23.908903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:23.916680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:23.917173 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:23.917605 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:23.918343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:23.918795 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:23.919222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:24.101456 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:24.119171 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-455d9450-f62e-4ee1-85cc-fdb379de8489 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.214714 Aug 24 04:53:24.119649 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 347/639] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:23 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:24.774907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:24.775455 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:24.782346 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:24.782835 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:24.783274 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:24.783979 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:24.784431 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:24.784865 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:24.864473 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:24.865935 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:24.879121 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:24.879941 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:24.880769 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:24.882075 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:24.884142 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:24.884626 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:24.991310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:25.000460 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-93a58c53-2aae-4a78-9dda-183fa44702b1 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1365 microversion: 2.1 time: 0.230089 Aug 24 04:53:25.001213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 293/640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:24 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:25.058995 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:25.067240 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5d323e29-efb6-4717-920a-50afcdea2fe0 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1513 microversion: 2.1 time: 0.209144 Aug 24 04:53:25.067826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 348/641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:24 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:25.153396 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:25.154056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:25.160486 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:25.160980 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:25.161420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:25.162149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:25.162606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:25.163030 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:25.315567 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:25.327177 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-57220e2e-1800-4bbd-889f-1f71236d2f4f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.177604 Aug 24 04:53:25.327778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 294/642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:25 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:26.021699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:26.022465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:26.031357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:26.031888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:26.032658 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:26.033413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:26.034126 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:26.034558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:26.099147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:26.102041 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:26.110643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:26.111284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:26.111884 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:26.115197 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:26.115925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:26.116737 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:26.328546 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:26.346133 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e470558d-af12-45cf-8533-4f726404cc18 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1365 microversion: 2.1 time: 0.328297 Aug 24 04:53:26.358912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 349/643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:26 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:26.366629 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-a19b6b20-9ae6-4ab5-9352-db5bca0bd5fa req-8b98bdd7-6f1c-48b7-9bb9-de37e75d2da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b95f69-cad3-4702-ae63-d4236e2d414c", "tag": "8c928cbe-9d51-4cfe-be31-9ab8a69c1530"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:26.380981 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-a19b6b20-9ae6-4ab5-9352-db5bca0bd5fa req-8b98bdd7-6f1c-48b7-9bb9-de37e75d2da3 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:26.381345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-a19b6b20-9ae6-4ab5-9352-db5bca0bd5fa req-8b98bdd7-6f1c-48b7-9bb9-de37e75d2da3 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:26.381981 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-a19b6b20-9ae6-4ab5-9352-db5bca0bd5fa req-8b98bdd7-6f1c-48b7-9bb9-de37e75d2da3 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:26.395920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-a19b6b20-9ae6-4ab5-9352-db5bca0bd5fa req-8b98bdd7-6f1c-48b7-9bb9-de37e75d2da3 service nova] Creating event network-changed:8c928cbe-9d51-4cfe-be31-9ab8a69c1530 for instance a0b95f69-cad3-4702-ae63-d4236e2d414c on hv-cinder-85426 Aug 24 04:53:26.402408 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-a19b6b20-9ae6-4ab5-9352-db5bca0bd5fa req-8b98bdd7-6f1c-48b7-9bb9-de37e75d2da3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042071 Aug 24 04:53:26.403474 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 350/644] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:26.410348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:26.411521 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:26.421560 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:26.422492 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:26.423043 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:26.423883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:26.424521 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:26.425144 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:26.749120 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:26.760772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-549bad17-9fb6-4798-af64-bebbfc59b494 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1513 microversion: 2.1 time: 0.675208 Aug 24 04:53:26.761709 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 295/645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:26 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1513 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:26.855040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:26.864420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-07a0a09e-4c14-47b3-8df5-1e65a6025618 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.459371 Aug 24 04:53:26.865136 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 351/646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:26 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:27.086217 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-dfe53ca9-b64e-4d10-8a28-305e91016bdc req-f07806b7-afea-4d1e-a3fc-cffb637db0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30222b89-a924-4cd1-bc8f-94ce4ff4cee2", "name": "network-vif-deleted", "tag": "f73da800-22b2-456d-be85-48f961ca29fe"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:27.097570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-dfe53ca9-b64e-4d10-8a28-305e91016bdc req-f07806b7-afea-4d1e-a3fc-cffb637db0cc service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:27.098237 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-dfe53ca9-b64e-4d10-8a28-305e91016bdc req-f07806b7-afea-4d1e-a3fc-cffb637db0cc service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:27.098858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-dfe53ca9-b64e-4d10-8a28-305e91016bdc req-f07806b7-afea-4d1e-a3fc-cffb637db0cc service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:27.111911 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-dfe53ca9-b64e-4d10-8a28-305e91016bdc req-f07806b7-afea-4d1e-a3fc-cffb637db0cc service nova] Creating event network-vif-deleted:f73da800-22b2-456d-be85-48f961ca29fe for instance 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 on hv-cinder-85426 Aug 24 04:53:27.118426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-dfe53ca9-b64e-4d10-8a28-305e91016bdc req-f07806b7-afea-4d1e-a3fc-cffb637db0cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035719 Aug 24 04:53:27.119241 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 296/647] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:53:27.375728 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:27.376389 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:27.383754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:27.384250 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:27.384687 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:27.385390 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:27.385848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:27.386312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:27.530565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:27.539761 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f0c532c9-3e41-47c1-aadd-c7ce76ee959b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1365 microversion: 2.1 time: 0.166691 Aug 24 04:53:27.540354 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 352/648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:27 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:27.784440 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:27.785049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:27.792928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:27.793431 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:27.793864 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:27.794610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:27.795064 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:27.795488 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:27.869306 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f652b0da0bf841dab4d3ed6e9e9c1f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e1a77e4404c48b4cfdc745668a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:27.882491 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a40aca4b-cd40-4e75-b9a0-3b32958fc2be tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 200 len: 1471 microversion: 2.1 time: 0.102136 Aug 24 04:53:27.883084 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 297/649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:27 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 1471 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:27.902254 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:27.902857 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:27.909235 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:27.910071 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:27.910698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:27.911660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:27.912316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:27.912740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:28.115286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:28.126418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7170bb46-7400-4701-bb32-2d32f8715aaf tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.228378 Aug 24 04:53:28.126880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 353/650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:27 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:28.562949 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:28.565006 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:28.572767 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:28.573248 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:28.573676 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:28.574400 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:28.574845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:28.575291 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:28.792369 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:28.802854 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a33192ab-9979-41ba-867f-c524a258f55c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1365 microversion: 2.1 time: 0.244720 Aug 24 04:53:28.803475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 298/651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:28 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:28.905157 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:28.905880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] [instance: 30222b89-a924-4cd1-bc8f-94ce4ff4cee2] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:28.912796 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:28.913921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:28.914727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:28.915533 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:28.915996 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:28.916425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:28.934491 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] HTTP exception thrown: Instance 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 could not be found. Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Request method failure captured: Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 HTTP/1.1 Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa4TBS5G4gYp8-NxyoZf68ybNJ31WRoDyOrt128M0rRJBBU4hufh5lfL0iovgju8bCDBZy-9uFw83DrsHkeLcobf7Ah78lPc4BbjIjBV_gRl4NbZJ5BSjY7-vfbtKo_7M75KNnBUWCnrH5PUblofKJYE23jqBej8Z3Zm8ogXhsgX2go Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: f99e1a77e4404c48b4cfdc745668a496 Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2126527978 Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:53:28.936181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f99e1a77e4404c48b4cfdc745668a496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f99e1a77e4404c48b4cfdc745668a496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f99e1a77e4404c48b4cfdc745668a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f99e1a77e4404c48b4cfdc745668a496"}]}] Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesSnapshotTestJSON-2126527978 Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: f99e1a77e4404c48b4cfdc745668a496 Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2126527978 Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesSnapshotTestJSON-2126527978-project Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: f652b0da0bf841dab4d3ed6e9e9c1f88 Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesSnapshotTestJSON-2126527978-project Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 could not be found. Aug 24 04:53:28.937684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '30222b89-a924-4cd1-bc8f-94ce4ff4cee2'} Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 could not be found. Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:28.938540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 could not be found. Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 could not be found. Aug 24 04:53:28.939940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:28.941201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] Returning 404 to user: Instance 30222b89-a924-4cd1-bc8f-94ce4ff4cee2 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:28.941201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6a95f381-fe9b-4cb1-89ba-a84529a77016 tempest-VolumesSnapshotTestJSON-2126527978 tempest-VolumesSnapshotTestJSON-2126527978-project] 10.222.0.60 "GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2" status: 404 len: 111 microversion: 2.1 time: 0.036701 Aug 24 04:53:28.941201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 354/652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:28 2022] GET /compute/v2.1/servers/30222b89-a924-4cd1-bc8f-94ce4ff4cee2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:53:29.148803 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:29.150334 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:29.157096 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:29.157746 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:29.158407 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:29.159116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:29.159829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:29.160511 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:29.324480 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:29.335054 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-cf495efb-a93d-4345-9c4b-6b56918ef515 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.191326 Aug 24 04:53:29.336266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 299/653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:29 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:29.825504 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:29.826151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:29.832307 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:29.832792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:29.833224 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:29.833922 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:29.834413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:29.834835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:29.976299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:29.985360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0bbc5138-c785-4c15-a76c-56f18fe56afd tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1365 microversion: 2.1 time: 0.163688 Aug 24 04:53:29.986010 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 355/654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:29 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:30.358729 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:30.359344 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:30.366429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:30.367458 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:30.367895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:30.368603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:30.369058 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:30.369485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:30.519337 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:30.531039 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d60d14ec-f440-4997-b56b-775c1f2d8d15 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.176581 Aug 24 04:53:30.531840 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 300/655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:30 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:30.771737 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-8c2f2bfe-bb8e-4ceb-9b50-c2665bc726cb req-ebbab0dc-1469-4cf8-a1b2-bf7503be5132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b95f69-cad3-4702-ae63-d4236e2d414c", "name": "network-vif-plugged", "status": "completed", "tag": "8c928cbe-9d51-4cfe-be31-9ab8a69c1530"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:30.785451 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-8c2f2bfe-bb8e-4ceb-9b50-c2665bc726cb req-ebbab0dc-1469-4cf8-a1b2-bf7503be5132 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:30.785938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-8c2f2bfe-bb8e-4ceb-9b50-c2665bc726cb req-ebbab0dc-1469-4cf8-a1b2-bf7503be5132 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:30.786388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-8c2f2bfe-bb8e-4ceb-9b50-c2665bc726cb req-ebbab0dc-1469-4cf8-a1b2-bf7503be5132 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:30.797967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-8c2f2bfe-bb8e-4ceb-9b50-c2665bc726cb req-ebbab0dc-1469-4cf8-a1b2-bf7503be5132 service nova] Creating event network-vif-plugged:8c928cbe-9d51-4cfe-be31-9ab8a69c1530 for instance a0b95f69-cad3-4702-ae63-d4236e2d414c on hv-cinder-85426 Aug 24 04:53:30.802789 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-8c2f2bfe-bb8e-4ceb-9b50-c2665bc726cb req-ebbab0dc-1469-4cf8-a1b2-bf7503be5132 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034992 Aug 24 04:53:30.803493 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 356/656] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:31.008528 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:31.009162 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:31.017015 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:31.017681 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:31.018202 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:31.019172 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:31.019862 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:31.020594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:31.189001 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:31.197494 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-37088bec-e598-41a4-9c0b-5f7d7ce4ac16 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1365 microversion: 2.1 time: 0.192875 Aug 24 04:53:31.198112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 301/657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:31 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:31.552018 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:31.553062 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=10 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:31.557563 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:31.558325 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:31.560377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:31.567221 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:31.568738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:31.568738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:31.569149 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:31.569893 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:31.570576 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:31.739175 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:31.748565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-60f92073-057e-4e5c-bbbb-f21b17e9a27c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.198286 Aug 24 04:53:31.749349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 357/658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:31 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:32.219015 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:32.219560 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:32.222152 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:32.227727 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:32.228211 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:32.228638 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:32.229327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:32.229796 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:32.230257 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:32.374167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:32.381771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d3f97bc1-8eab-4cfb-a647-603665a4cd90 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1365 microversion: 2.1 time: 0.166761 Aug 24 04:53:32.382962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 302/659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:32 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:32.780655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:32.781496 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:32.789433 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:32.789932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:32.790410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:32.791137 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:32.791596 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:32.792029 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:32.945747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:32.954988 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-96550556-bbd0-43ea-a2ad-5bc986e83593 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.178273 Aug 24 04:53:32.955741 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 358/660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:32 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:33.404226 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:33.404835 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:33.412098 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:33.412586 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:33.413374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:33.413812 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:33.414410 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:33.414834 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:33.590628 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:33.600352 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-95a2e84a-3eda-49d0-9c0e-e5cdc9360092 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1365 microversion: 2.1 time: 0.200265 Aug 24 04:53:33.601120 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 303/661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:33 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:33.980652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:33.981580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:33.992540 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:33.993497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:33.994255 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:33.995407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:33.996330 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:33.996962 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:34.197320 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:34.206151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-bd79f857-db47-4d75-b561-5eb07ab86056 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.231334 Aug 24 04:53:34.206739 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 359/662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:33 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:34.622233 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:34.622809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:34.629775 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:34.630308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:34.630764 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:34.631483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:34.632531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:34.632957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:34.785070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:34.795979 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-aa58cd3d-3a66-493a-b785-39b09e46d532 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1365 microversion: 2.1 time: 0.177997 Aug 24 04:53:34.796427 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 304/663] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:34 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:35.229739 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:35.230370 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:35.236972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:35.237458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:35.237882 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:35.238615 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:35.239073 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:35.239484 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:35.397725 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:35.407432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-481c1146-9c9a-4f55-8f99-bfa686bb538e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.181998 Aug 24 04:53:35.408025 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 360/664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:35 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:35.826345 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:35.826968 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:35.833786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:35.834312 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:35.835239 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:35.835960 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:35.836422 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:35.836835 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:35.996042 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:36.004660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b03b80fd-22be-449a-bfd0-61eb1b5c272c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1555 microversion: 2.1 time: 0.182246 Aug 24 04:53:36.005286 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 305/665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:35 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:36.026771 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0b2f005b-e18b-460e-b876-7f4929ba82e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:36.027271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0b2f005b-e18b-460e-b876-7f4929ba82e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:36.034370 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0b2f005b-e18b-460e-b876-7f4929ba82e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:36.034862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0b2f005b-e18b-460e-b876-7f4929ba82e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:36.035304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0b2f005b-e18b-460e-b876-7f4929ba82e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:36.036170 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0b2f005b-e18b-460e-b876-7f4929ba82e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:36.036656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0b2f005b-e18b-460e-b876-7f4929ba82e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:36.037044 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0b2f005b-e18b-460e-b876-7f4929ba82e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:36.125826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0b2f005b-e18b-460e-b876-7f4929ba82e6 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103010 Aug 24 04:53:36.126565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 361/666] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 24 04:53:36 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:36.430220 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:36.430839 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:36.445374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:36.445870 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:36.446340 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:36.447053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:36.447514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:36.447938 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:36.461350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-09a024cd-3776-4e3c-ba52-d8e4b4165b6d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:36.464811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-09a024cd-3776-4e3c-ba52-d8e4b4165b6d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:36.481366 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-09a024cd-3776-4e3c-ba52-d8e4b4165b6d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:36.483359 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-09a024cd-3776-4e3c-ba52-d8e4b4165b6d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:36.484736 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-09a024cd-3776-4e3c-ba52-d8e4b4165b6d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:36.485989 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-09a024cd-3776-4e3c-ba52-d8e4b4165b6d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:36.487140 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-09a024cd-3776-4e3c-ba52-d8e4b4165b6d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:36.487759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-09a024cd-3776-4e3c-ba52-d8e4b4165b6d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:36.596852 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-09a024cd-3776-4e3c-ba52-d8e4b4165b6d tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "POST /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/action" status: 202 len: 0 microversion: 2.1 time: 0.140150 Aug 24 04:53:36.597728 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 362/667] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:53:36 2022] POST /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:53:36.607782 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:36.608543 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:36.621111 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:36.622140 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:36.622968 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:36.624522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:36.625424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:36.626348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:36.876912 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:36.888224 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-cf23981f-c8fb-43eb-91e7-5b4395344042 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.462373 Aug 24 04:53:36.888819 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 306/668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:36 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:37.116630 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:37.126055 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-accb2f62-53cf-4b46-861d-67a135b15d76 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1750 microversion: 2.1 time: 0.522885 Aug 24 04:53:37.138039 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 363/669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:36 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1750 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:37.918784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:37.920364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:37.930855 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:37.932170 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:37.933441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:37.935070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:37.935708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:37.936528 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:38.149939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:38.151189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:38.160450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:38.161266 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:38.163623 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:38.163623 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:38.164359 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:38.165076 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:38.182724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:38.419784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:38.431096 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-277e6b4e-831e-4d5f-8ff8-6caf924c855a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.517663 Aug 24 04:53:38.432382 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 307/670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:37 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:38.458845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-09c88bac-97d1-49e9-98b5-f5f2c7298ac4 req-f793f862-2a63-4160-a981-e358c03a5435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b95f69-cad3-4702-ae63-d4236e2d414c", "tag": "8c928cbe-9d51-4cfe-be31-9ab8a69c1530"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:38.484948 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-09c88bac-97d1-49e9-98b5-f5f2c7298ac4 req-f793f862-2a63-4160-a981-e358c03a5435 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:38.485879 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-09c88bac-97d1-49e9-98b5-f5f2c7298ac4 req-f793f862-2a63-4160-a981-e358c03a5435 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:38.486770 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-09c88bac-97d1-49e9-98b5-f5f2c7298ac4 req-f793f862-2a63-4160-a981-e358c03a5435 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:38.509970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-09c88bac-97d1-49e9-98b5-f5f2c7298ac4 req-f793f862-2a63-4160-a981-e358c03a5435 service nova] Creating event network-changed:8c928cbe-9d51-4cfe-be31-9ab8a69c1530 for instance a0b95f69-cad3-4702-ae63-d4236e2d414c on hv-cinder-85426 Aug 24 04:53:38.519511 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-09c88bac-97d1-49e9-98b5-f5f2c7298ac4 req-f793f862-2a63-4160-a981-e358c03a5435 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066727 Aug 24 04:53:38.520792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 308/671] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:53:38.550126 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:38.564155 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0089d3a3-8b5b-4c9d-b5e3-67c274ba0fba tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1750 microversion: 2.1 time: 0.418156 Aug 24 04:53:38.565077 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 364/672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:38 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1750 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:39.466757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:39.467648 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:39.475647 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:39.476331 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:39.476908 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:39.477681 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:39.478182 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:39.478615 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:39.500934 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=100 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:39.590023 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:39.590760 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:39.597881 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:39.598423 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:39.599050 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:39.599767 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:39.600517 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:39.600949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:39.669259 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:39.679835 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f1f52cd4-63d8-457b-9cb7-fe18dc31fe89 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.218554 Aug 24 04:53:39.680428 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 309/673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:39 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:39.821783 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:39.834115 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b12d53e9-8331-46d0-8c14-a839f18ce32b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.248177 Aug 24 04:53:39.836367 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 365/674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:39 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:40.705241 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:40.705926 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:40.714617 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:40.715104 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:40.715536 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:40.716253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:40.716702 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:40.717120 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:40.862472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:40.863695 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:40.874280 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:40.874952 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:40.875578 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:40.876697 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:40.877558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:40.878135 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:40.886402 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:40.902629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0bae3a53-30ea-4306-b593-b903d04a78a6 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.201725 Aug 24 04:53:40.903622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 310/675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:40 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:41.064845 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:41.074686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8f3fdaa6-431f-4cbb-97cc-00e7b0f646f0 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.219372 Aug 24 04:53:41.075532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 366/676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:40 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:41.931845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:41.934817 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:41.946205 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:41.947112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:41.947864 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:41.948863 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:41.949353 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:41.949774 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:42.097905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:42.098740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:42.106846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:42.107357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:42.107791 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:42.108571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:42.109077 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:42.109562 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:42.197292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:42.208585 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-50fbf27d-9688-4b62-9e39-a3c5db182493 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.284593 Aug 24 04:53:42.209358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 311/677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:41 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:42.542715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:42.559829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b1ff5ce6-0a43-43ca-8ef7-d5b20e238599 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.466069 Aug 24 04:53:42.560748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 367/678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:42 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:43.236977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:43.237801 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:43.246398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:43.246888 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:43.247354 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:43.248053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:43.248767 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:43.248961 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:43.407447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:43.420421 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-de05527c-3eba-471b-b053-f6bf91f6f746 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.187604 Aug 24 04:53:43.420835 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 312/679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:43 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:43.583612 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:43.584359 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:43.591941 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:43.592332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:43.592762 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:43.593472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:43.593923 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:43.594377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:44.020185 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:44.031382 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-90cff726-cb36-44de-bd92-30d4d83ce3f2 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.453367 Aug 24 04:53:44.031954 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 368/680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:43 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:44.443413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:44.444036 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:44.451775 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:44.452274 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:44.452721 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:44.453444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:44.453894 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:44.454355 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:44.611790 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:44.627649 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0aa57998-f4c7-410c-ba3c-44c6e24a8c07 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.188370 Aug 24 04:53:44.628741 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 313/681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:44 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:45.054458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:45.055556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:45.062530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:45.063027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:45.063467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:45.064197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:45.064646 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:45.065066 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:45.274567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:45.284387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9b1845c5-1811-426c-9e6f-05855bf84201 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.234744 Aug 24 04:53:45.285017 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 369/682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:45 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:45.652252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:45.653006 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:45.660202 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:45.660693 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:45.661152 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:45.662522 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:45.662979 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:45.663407 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:45.872081 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:45.880857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-522aad62-febb-43a6-ba9e-d6da0d0f144a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.233169 Aug 24 04:53:45.881511 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 314/683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:45 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:46.307424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:46.308164 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:46.315183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:46.315683 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:46.316121 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:46.316827 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:46.317286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:46.317733 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:46.527129 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:46.535858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-178c1d95-8e53-4805-bbeb-78682f2c7542 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.232928 Aug 24 04:53:46.536451 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 370/684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:46 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:46.904434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:46.905885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:46.919261 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:46.920085 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:46.920786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:46.921895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:46.922730 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:46.923514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:47.067512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:47.076556 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-54d803aa-39ad-40b4-b02e-1608c4c1aa51 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.176203 Aug 24 04:53:47.077193 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 315/685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:46 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:47.565271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:47.565963 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:47.574337 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:47.574838 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:47.575268 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:47.575984 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:47.576430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:47.576846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:47.794770 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:47.803778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-624fc081-e663-4cd6-a82f-ce0a67b22b92 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.242272 Aug 24 04:53:47.804378 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 371/686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:47 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:48.099520 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:48.100121 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:48.103330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:48.109576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:48.110132 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:48.110598 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:48.111289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:48.111736 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:48.112178 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:48.267400 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:48.276895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8a9586cd-bc6e-4f41-83a4-dfd268315b52 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.181249 Aug 24 04:53:48.277505 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 316/687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:48 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:48.827290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:48.828116 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:48.836396 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:48.836891 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:48.837331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:48.838082 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:48.838547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:48.838972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:49.026829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:49.041426 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f1245b23-afa3-41b2-a88d-30e91e35cc8e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.218040 Aug 24 04:53:49.042355 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 372/688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:48 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:49.299540 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:49.300138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:49.307051 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:49.307534 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:49.307974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:49.308706 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:49.309150 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:49.309577 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:49.463835 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:49.472997 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-908508b8-a50b-481d-95a6-870565c3a83d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.177573 Aug 24 04:53:49.473583 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 317/689] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:49 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:50.069662 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:50.070864 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:50.082893 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:50.083845 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:50.084716 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:50.086400 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:50.087245 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:50.088006 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:50.259345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:50.272081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-18551460-2cfd-45d7-80d7-4c604ee59ba1 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.210173 Aug 24 04:53:50.272829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 373/690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:50 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:50.494450 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:50.495336 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:50.501817 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:50.502344 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:50.502778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:50.503478 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:50.503923 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:50.504338 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:50.651076 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:50.659659 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-93e0d550-838a-40c0-9a27-dea94889d4e3 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.169269 Aug 24 04:53:50.660238 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 318/691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:50 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:51.299398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:51.300497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:51.312470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:51.313343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:51.314154 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:51.315448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:51.316256 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:51.317027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:51.489008 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:51.498851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e03ebc85-49c1-4fe6-8422-8eef310e5d65 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.206144 Aug 24 04:53:51.499440 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 374/692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:51 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:51.681682 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:51.682436 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:51.689683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:51.690221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:51.690657 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:51.691372 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:51.691917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:51.692377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:51.835228 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:51.845281 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0ecac9b6-5b1e-469b-9aa6-3cafb9c8776c tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.168196 Aug 24 04:53:51.845903 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 319/693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:51 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:52.527679 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:52.530102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:52.551438 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:52.551879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:52.552765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:52.554209 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:52.555094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:52.555917 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:52.877753 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:52.879566 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:52.890767 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:52.891993 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:52.892628 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:52.893829 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:52.894533 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:52.895211 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:52.919957 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:52.939306 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e683eabf-6664-4ea8-8ea4-8a5e880a27ee tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.421371 Aug 24 04:53:52.940903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 375/694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:52 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:53.110356 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:53.119642 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-80e24c68-92c6-437d-b723-b39c6ae16a50 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1735 microversion: 2.1 time: 0.247531 Aug 24 04:53:53.120256 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 320/695] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:52 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:53.967799 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:53.968924 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:53.980513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:53.981320 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:53.982242 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:53.983343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:53.983839 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:53.984362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:54.225237 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:54.242569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c01d748f-f205-487c-802d-d2a8ff64fc27 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.278322 Aug 24 04:53:54.249982 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 376/696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:53 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:54.437168 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:54.438235 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:54.447112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:54.447735 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:54.448353 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:54.449185 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:54.449745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:54.450321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:54.654406 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:54.671077 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0653bca3-0d2a-4ba6-963d-2a29653fbd87 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1715 microversion: 2.1 time: 0.532289 Aug 24 04:53:54.672191 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 321/697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:54 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1715 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:54.869696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:54.870232 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:54.876564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:54.877058 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:54.877505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:54.878257 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:54.878723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:54.879150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:54.974413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] HTTP exception thrown: Cannot 'detach_volume' instance 15409608-f562-4e3c-af4c-e918e3f5921b while it is in vm_state rescued Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Request method failure captured: Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: DELETE /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments/6e290423-7630-4511-92b1-f0db5d9c8baf HTTP/1.1 Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa20IyEzD7U6F30SSskJS5-VXIlAQDQ0K19oWqsUTewrcIbAUWR7Aa4Zzl27820bwdwcAamNBDZvl1f_fj13FMS6YF8vnY0uVTe4hRADGrPARVoyHJZb11Pd6NwA_3kVyPjQEJcmGyj1ZzRHYY-6VD3wIiyVmXmgLBI9a6Fr0LxiYxo Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:53:54.977094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1a1f238eb4f34d44ac93b85181ad7001"}]}] Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 3d5408f9ada24654839e479c7fe385ce Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:53:54.979896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Cannot 'detach_volume' instance 15409608-f562-4e3c-af4c-e918e3f5921b while it is in vm_state rescued Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'server_id': '15409608-f562-4e3c-af4c-e918e3f5921b', 'id': '6e290423-7630-4511-92b1-f0db5d9c8baf'} Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 15409608-f562-4e3c-af4c-e918e3f5921b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:54.981883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 15409608-f562-4e3c-af4c-e918e3f5921b while it is in vm_state rescued Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 15409608-f562-4e3c-af4c-e918e3f5921b while it is in vm_state rescued Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.984636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Returning 409 to user: Cannot 'detach_volume' instance 15409608-f562-4e3c-af4c-e918e3f5921b while it is in vm_state rescued {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:54.986258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5f976062-90b1-40ac-8d19-97c8ae10c574 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "DELETE /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments/6e290423-7630-4511-92b1-f0db5d9c8baf" status: 409 len: 152 microversion: 2.1 time: 0.114301 Aug 24 04:53:54.986258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 377/698] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:53:54 2022] DELETE /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments/6e290423-7630-4511-92b1-f0db5d9c8baf => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:53:54.989234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8558b738-20f7-4f21-93b1-e4e80d25eb30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:54.989809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8558b738-20f7-4f21-93b1-e4e80d25eb30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:54.997680 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8558b738-20f7-4f21-93b1-e4e80d25eb30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:54.998208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8558b738-20f7-4f21-93b1-e4e80d25eb30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:54.998641 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8558b738-20f7-4f21-93b1-e4e80d25eb30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:54.999348 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8558b738-20f7-4f21-93b1-e4e80d25eb30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:54.999793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8558b738-20f7-4f21-93b1-e4e80d25eb30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:55.000208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8558b738-20f7-4f21-93b1-e4e80d25eb30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:55.078519 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8558b738-20f7-4f21-93b1-e4e80d25eb30 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "POST /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/action" status: 202 len: 0 microversion: 2.1 time: 0.093855 Aug 24 04:53:55.079183 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 322/699] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:53:54 2022] POST /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:53:55.090068 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:55.090688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:55.098165 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:55.098665 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:55.099103 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:55.099821 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:55.100274 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:55.100703 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:55.278840 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:55.280208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:55.291268 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:55.291786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:55.292223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:55.292952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:55.293401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:55.293814 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:55.372016 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:55.389138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ccfb8ac6-e7ed-4040-9029-9b48d6a85323 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1723 microversion: 2.1 time: 0.303413 Aug 24 04:53:55.390513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 378/700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:55 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:55.563927 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:55.573746 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5964d771-56b0-40fe-bbdc-b2c5ac1dc43e tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1755 microversion: 2.1 time: 0.303830 Aug 24 04:53:55.574747 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 323/701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:55 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1755 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:56.425201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:56.425897 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:56.433172 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:56.433657 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:56.434123 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:56.434844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:56.435304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:56.435707 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:56.601293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:56.602831 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:56.613731 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:56.614641 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:56.615413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:56.617705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:56.618385 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:56.618969 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:56.739316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:56.749598 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3b99e04f-8274-47b9-92b5-f69c70109dd2 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1723 microversion: 2.1 time: 0.328263 Aug 24 04:53:56.749870 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:53:56.750359 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Wed Aug 24 04:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 (ip 10.222.0.60) !!! Aug 24 04:53:56.751197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 379/702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:56 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:56.845013 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:56.855705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-13b2af30-0e4c-4136-9ade-b77ebe849bbb tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1758 microversion: 2.1 time: 0.262051 Aug 24 04:53:56.856329 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 324/703] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:56 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1758 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:57.485233 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8e72fa85-b516-4e65-9308-9847177dcc92 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:57.487665 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8e72fa85-b516-4e65-9308-9847177dcc92 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:57.495519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e72fa85-b516-4e65-9308-9847177dcc92 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:57.496156 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e72fa85-b516-4e65-9308-9847177dcc92 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:57.496631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e72fa85-b516-4e65-9308-9847177dcc92 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:57.497476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e72fa85-b516-4e65-9308-9847177dcc92 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:57.497978 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e72fa85-b516-4e65-9308-9847177dcc92 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:57.498500 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e72fa85-b516-4e65-9308-9847177dcc92 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:57.534226 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8e72fa85-b516-4e65-9308-9847177dcc92 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053467 Aug 24 04:53:57.535106 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 380/704] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:57 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:53:57.606413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:57.607386 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:57.617832 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:57.618977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:57.619565 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:57.620444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:57.621143 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:57.621460 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:57.626224 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:57.654582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Going to try to terminate instance {{(pid=127416) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:53:57.752631 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1cca405c-b9ad-41a1-b628-e87afa6821ae tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "DELETE /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 204 len: 0 microversion: 2.1 time: 0.151716 Aug 24 04:53:57.753270 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 325/705] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:53:57 2022] DELETE /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:53:57.763970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:57.764599 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:57.772562 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:57.773602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:57.774218 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:57.775290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:57.775737 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:57.776193 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:57.777147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:57.778190 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:57.779513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:57.786905 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:57.787446 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:57.787997 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:57.789912 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:57.790727 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:57.791400 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:58.046938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:58.055882 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:58.056177 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-aa6347e8-d0de-4d8f-8237-37d444d20781 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1673 microversion: 2.1 time: 0.296288 Aug 24 04:53:58.056768 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 381/706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:57 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1673 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:58.065026 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-67eb0912-b4e8-42cb-9203-99af482ce860 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1723 microversion: 2.1 time: 0.293795 Aug 24 04:53:58.065957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 326/707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:57 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:59.021467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-40a0be7b-e7f7-402b-9e4f-ac6f0b70439a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:59.022124 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-40a0be7b-e7f7-402b-9e4f-ac6f0b70439a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:59.029785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-40a0be7b-e7f7-402b-9e4f-ac6f0b70439a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.030312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-40a0be7b-e7f7-402b-9e4f-ac6f0b70439a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.030754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-40a0be7b-e7f7-402b-9e4f-ac6f0b70439a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.031499 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-40a0be7b-e7f7-402b-9e4f-ac6f0b70439a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.032040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-40a0be7b-e7f7-402b-9e4f-ac6f0b70439a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.032380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-40a0be7b-e7f7-402b-9e4f-ac6f0b70439a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.066574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-40a0be7b-e7f7-402b-9e4f-ac6f0b70439a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments/d3abf31a-a9c0-4b2d-a205-ec3e36f64422" status: 200 len: 194 microversion: 2.20 time: 0.049353 Aug 24 04:53:59.067197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 382/708] 10.222.0.60 () {60 vars in 1454 bytes} [Wed Aug 24 04:53:59 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments/d3abf31a-a9c0-4b2d-a205-ec3e36f64422 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:53:59.082214 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:59.083201 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:59.091610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.092208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.092831 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.093606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.094108 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.094626 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.096470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:59.097614 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:59.108844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.109526 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.110053 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.111202 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.112868 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.112868 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.315409 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:59.326228 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-360fb0c7-e94c-499f-959f-816d8c79ac8c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1673 microversion: 2.1 time: 0.251228 Aug 24 04:53:59.327282 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 327/709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:59 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1673 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:59.334831 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:59.335668 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:59.336843 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:59.344057 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.344567 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.345036 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.345722 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.346243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.346667 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.350141 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a5e09080-e02c-4d7a-9ce4-7adb84f3661b tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1723 microversion: 2.1 time: 0.260805 Aug 24 04:53:59.350771 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 383/710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:59 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:59.450691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lazy-loading 'services' on Instance uuid 5eeaea49-9c15-4e0a-a446-98d3191293c8 {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:53:59.561610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3a109844-b9d9-4950-80fc-eb04cc85f047 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments/d3abf31a-a9c0-4b2d-a205-ec3e36f64422" status: 202 len: 0 microversion: 2.20 time: 0.232169 Aug 24 04:53:59.562750 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 328/711] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Aug 24 04:53:59 2022] DELETE /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments/d3abf31a-a9c0-4b2d-a205-ec3e36f64422 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:53:59.572276 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3ebaf903-6e8d-4d93-af54-2d4d5b8cd6e0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:59.574695 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3ebaf903-6e8d-4d93-af54-2d4d5b8cd6e0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:59.581939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaf903-6e8d-4d93-af54-2d4d5b8cd6e0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.582501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaf903-6e8d-4d93-af54-2d4d5b8cd6e0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.582945 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaf903-6e8d-4d93-af54-2d4d5b8cd6e0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.583664 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaf903-6e8d-4d93-af54-2d4d5b8cd6e0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:59.584121 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaf903-6e8d-4d93-af54-2d4d5b8cd6e0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:59.584556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaf903-6e8d-4d93-af54-2d4d5b8cd6e0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:59.620566 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3ebaf903-6e8d-4d93-af54-2d4d5b8cd6e0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052746 Aug 24 04:53:59.621319 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 384/712] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 24 04:53:59 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:54:00.351326 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:00.352176 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:00.359148 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:00.359627 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:00.360063 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:00.360757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:00.361203 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:00.361616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:00.373760 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:00.374431 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:00.381476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:00.383407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:00.383407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:00.384033 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:00.384495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:00.384919 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:00.587510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:00.594305 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:00.595932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a02d651e-8b72-4b69-8cc0-49310bb21055 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1673 microversion: 2.1 time: 0.249076 Aug 24 04:54:00.596642 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 329/713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:00 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:00.603948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-615eb7a0-1057-49ce-8611-9fb6e4ba10a5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1723 microversion: 2.1 time: 0.235046 Aug 24 04:54:00.604528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 385/714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:00 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:00.635223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-190ba351-50a8-45a2-8fac-da4b75344e26 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:00.637589 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-190ba351-50a8-45a2-8fac-da4b75344e26 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:00.644397 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-190ba351-50a8-45a2-8fac-da4b75344e26 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:00.644879 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-190ba351-50a8-45a2-8fac-da4b75344e26 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:00.645309 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-190ba351-50a8-45a2-8fac-da4b75344e26 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:00.646029 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-190ba351-50a8-45a2-8fac-da4b75344e26 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:00.646480 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-190ba351-50a8-45a2-8fac-da4b75344e26 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:00.646898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-190ba351-50a8-45a2-8fac-da4b75344e26 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:00.677862 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-190ba351-50a8-45a2-8fac-da4b75344e26 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047709 Aug 24 04:54:00.678490 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 330/715] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 24 04:54:00 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:54:01.621189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:01.621918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:01.624369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=58 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:01.628400 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:01.629479 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:01.635641 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:01.636237 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:01.636675 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:01.637668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:01.638308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:01.638711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:01.639081 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:01.640033 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:01.640896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:01.642249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:01.643332 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:01.644025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:01.895943 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:01.910599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a0ccc745-ed12-4fb5-b2b2-413865ef17e4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1729 microversion: 2.1 time: 0.285941 Aug 24 04:54:01.921503 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 331/716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:01 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:01.927536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:01.935532 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-81d069c7-93b9-4965-870d-b379f929ba32 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:01.939201 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-81d069c7-93b9-4965-870d-b379f929ba32 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:01.945372 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ed93b6eb-9922-4f8b-8b66-b3304c13796c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1673 microversion: 2.1 time: 0.328388 Aug 24 04:54:01.946939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 386/717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:01 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1673 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:01.949805 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81d069c7-93b9-4965-870d-b379f929ba32 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:01.951204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81d069c7-93b9-4965-870d-b379f929ba32 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:01.951837 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e73e2724-3226-468a-b645-0016a0f207bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:01.952031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81d069c7-93b9-4965-870d-b379f929ba32 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:01.952548 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e73e2724-3226-468a-b645-0016a0f207bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:01.954396 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81d069c7-93b9-4965-870d-b379f929ba32 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:01.955101 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81d069c7-93b9-4965-870d-b379f929ba32 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:01.955905 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81d069c7-93b9-4965-870d-b379f929ba32 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:01.959610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e73e2724-3226-468a-b645-0016a0f207bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:01.960683 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e73e2724-3226-468a-b645-0016a0f207bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:01.961104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e73e2724-3226-468a-b645-0016a0f207bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:01.962046 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e73e2724-3226-468a-b645-0016a0f207bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:01.962410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e73e2724-3226-468a-b645-0016a0f207bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:01.962833 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e73e2724-3226-468a-b645-0016a0f207bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:02.000421 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-81d069c7-93b9-4965-870d-b379f929ba32 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078255 Aug 24 04:54:02.001494 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 332/718] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 24 04:54:01 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:54:02.049581 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e73e2724-3226-468a-b645-0016a0f207bc tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101349 Aug 24 04:54:02.050292 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 387/719] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 24 04:54:01 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:02.981212 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:02.981838 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:02.988883 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:02.989373 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:02.989818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:02.990559 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:02.991018 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:02.991510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:03.015076 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6b99e6b5-e4e6-4ab5-873b-52dc758d4a14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:03.017606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6b99e6b5-e4e6-4ab5-873b-52dc758d4a14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:03.025618 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b99e6b5-e4e6-4ab5-873b-52dc758d4a14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:03.026412 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b99e6b5-e4e6-4ab5-873b-52dc758d4a14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:03.026959 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b99e6b5-e4e6-4ab5-873b-52dc758d4a14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:03.027765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b99e6b5-e4e6-4ab5-873b-52dc758d4a14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:03.028349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b99e6b5-e4e6-4ab5-873b-52dc758d4a14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:03.029589 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6b99e6b5-e4e6-4ab5-873b-52dc758d4a14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:03.062826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6b99e6b5-e4e6-4ab5-873b-52dc758d4a14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052684 Aug 24 04:54:03.070077 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 388/720] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 24 04:54:03 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:03.126244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:03.126736 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:03.132894 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:03.133373 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:03.133797 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:03.134521 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:03.134972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:03.135384 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:03.162775 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:54:03.261239 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5fb202cc-92a1-48cf-8e81-b36fe3abbfbf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 204 len: 0 microversion: 2.20 time: 0.138690 Aug 24 04:54:03.262074 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 389/721] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 24 04:54:03 2022] DELETE /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 04:54:03.270950 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:03.271648 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:03.278998 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:03.280317 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:03.280317 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:03.280627 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:03.281092 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:03.281522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:03.374227 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:03.383380 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b51a971e-305f-4cea-9976-87c20d37869a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1673 microversion: 2.1 time: 0.406597 Aug 24 04:54:03.384242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 333/722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:02 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1673 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:03.603004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:03.612082 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:03.613589 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:03.614776 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ea76845b-0e4a-456c-a181-f778a96b62a5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.348307 Aug 24 04:54:03.615506 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 390/723] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:03 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:54:03.932696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-fde473a2-6f89-491b-8898-c09721897702 req-34986529-ad30-404d-8072-4f676a344679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15409608-f562-4e3c-af4c-e918e3f5921b", "tag": "3275601c-1146-4292-877e-cda074b8821f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:03.942820 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-fde473a2-6f89-491b-8898-c09721897702 req-34986529-ad30-404d-8072-4f676a344679 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:03.943401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-fde473a2-6f89-491b-8898-c09721897702 req-34986529-ad30-404d-8072-4f676a344679 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:03.943939 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-fde473a2-6f89-491b-8898-c09721897702 req-34986529-ad30-404d-8072-4f676a344679 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:03.956613 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-fde473a2-6f89-491b-8898-c09721897702 req-34986529-ad30-404d-8072-4f676a344679 service nova] Creating event network-changed:3275601c-1146-4292-877e-cda074b8821f for instance 15409608-f562-4e3c-af4c-e918e3f5921b on hv-cinder-85426 Aug 24 04:54:03.962713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-fde473a2-6f89-491b-8898-c09721897702 req-34986529-ad30-404d-8072-4f676a344679 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035597 Aug 24 04:54:03.963485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 334/724] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:04.405018 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:04.406040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:04.412606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:04.413654 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:04.414364 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:04.415387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:04.415881 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:04.417086 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:04.483637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:04.492653 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1567aef9-7f1a-4480-aa5d-c253f6bdc9d9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 200 len: 1606 microversion: 2.1 time: 0.091483 Aug 24 04:54:04.493224 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 391/725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:04 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 1606 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:04.922933 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:04.925300 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:04.933284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:04.933777 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:04.934402 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:04.935123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:04.935572 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:04.935986 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:05.092232 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:05.106114 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:05.108096 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:05.109485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-948bc3f8-0c12-4b9b-851d-2452d8db88cb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1725 microversion: 2.20 time: 0.472873 Aug 24 04:54:05.110127 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 335/726] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:04 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1725 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:05.513729 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:05.514542 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:05.521930 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:05.522462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:05.523156 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:05.524024 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:05.524515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:05.525086 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:05.546290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] HTTP exception thrown: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Request method failure captured: Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d HTTP/1.1 Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3DKU-H0f0UOvfBTpwdCRJuw4LGb8x5sm3i_Spm38K1R181ak2vWLi3qJl1d1n0lmPD_o7-KMQb4vcjVFQ-i77c9Srn7Msbs9A83DrnT9AdubKeVAnpwhaXTxnBef8m_nqIIUm7pLiVrrg0IevV-v0KH5agHhxIncSel0Pb5RTACR4 Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:54:05.547960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2d97457b5cc4100a1ca1685f4c371e5"}]}] Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 42ad8df34f8e405792afe94b91382122 Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:54:05.549422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '02869b36-2e27-488f-9e94-c82e7094038d'} Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:05.550213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:54:05.552570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:05.556669 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Returning 404 to user: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:05.556669 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a4948ef4-ab06-45da-8d15-229fdb23f72a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 404 len: 111 microversion: 2.1 time: 0.040961 Aug 24 04:54:05.556669 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 392/727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:05 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:05.561286 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fc3ae958-1f8b-4105-8282-1db5ce2392ea tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '.version_select at 0x7fb05090e4c0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:05.583104 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-fc3ae958-1f8b-4105-8282-1db5ce2392ea tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268150505" status: 202 len: 0 microversion: 2.1 time: 0.025815 Aug 24 04:54:05.584366 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 336/728] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Aug 24 04:54:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268150505 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:54:05.994773 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-1d81594c-e77b-4cf5-a143-cee7930f852b req-59a1130f-28f8-4248-903f-6e6023a69d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15409608-f562-4e3c-af4c-e918e3f5921b", "tag": "3275601c-1146-4292-877e-cda074b8821f"}, {"server_uuid": "02869b36-2e27-488f-9e94-c82e7094038d", "name": "network-vif-deleted", "tag": "1c0068ae-b002-49bf-bdba-6a7c76bf094f"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:06.006102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-1d81594c-e77b-4cf5-a143-cee7930f852b req-59a1130f-28f8-4248-903f-6e6023a69d37 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.007613 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-1d81594c-e77b-4cf5-a143-cee7930f852b req-59a1130f-28f8-4248-903f-6e6023a69d37 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.008088 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-1d81594c-e77b-4cf5-a143-cee7930f852b req-59a1130f-28f8-4248-903f-6e6023a69d37 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.023970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-1d81594c-e77b-4cf5-a143-cee7930f852b req-59a1130f-28f8-4248-903f-6e6023a69d37 service nova] Creating event network-changed:3275601c-1146-4292-877e-cda074b8821f for instance 15409608-f562-4e3c-af4c-e918e3f5921b on hv-cinder-85426 Aug 24 04:54:06.023970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-1d81594c-e77b-4cf5-a143-cee7930f852b req-59a1130f-28f8-4248-903f-6e6023a69d37 service nova] Creating event network-vif-deleted:1c0068ae-b002-49bf-bdba-6a7c76bf094f for instance 02869b36-2e27-488f-9e94-c82e7094038d on hv-cinder-85426 Aug 24 04:54:06.030587 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-1d81594c-e77b-4cf5-a143-cee7930f852b req-59a1130f-28f8-4248-903f-6e6023a69d37 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040594 Aug 24 04:54:06.031671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 393/729] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:06.134443 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.135337 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:06.141769 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.142307 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.143003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.143718 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.144176 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.144598 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.255978 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:06.274708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:06.276820 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:06.279034 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2c3fd287-b8fd-4191-87d6-98fecab246c6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 200 len: 1657 microversion: 2.20 time: 0.150069 Aug 24 04:54:06.295322 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 337/730] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:06 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 1657 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:06.472632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-17cf86b6-a1a5-4087-bce7-1bff4ff1c845 req-553f6f4b-d1a0-447d-a843-50266b1e6171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eeaea49-9c15-4e0a-a446-98d3191293c8", "name": "network-vif-deleted", "tag": "6bd895e9-3f00-4d89-aab3-7b4bbc97e62d"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:06.483547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-17cf86b6-a1a5-4087-bce7-1bff4ff1c845 req-553f6f4b-d1a0-447d-a843-50266b1e6171 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.484028 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-17cf86b6-a1a5-4087-bce7-1bff4ff1c845 req-553f6f4b-d1a0-447d-a843-50266b1e6171 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.484529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-17cf86b6-a1a5-4087-bce7-1bff4ff1c845 req-553f6f4b-d1a0-447d-a843-50266b1e6171 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.497594 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-17cf86b6-a1a5-4087-bce7-1bff4ff1c845 req-553f6f4b-d1a0-447d-a843-50266b1e6171 service nova] Creating event network-vif-deleted:6bd895e9-3f00-4d89-aab3-7b4bbc97e62d for instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 on hv-cinder-85426 Aug 24 04:54:06.502785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-17cf86b6-a1a5-4087-bce7-1bff4ff1c845 req-553f6f4b-d1a0-447d-a843-50266b1e6171 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036468 Aug 24 04:54:06.503706 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 394/731] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:06.814579 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-654b7a2e-c88a-4072-bb47-d0dc6274e42a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'create', calling method: .version_select at 0x7fb05090cee0>, body: {"keypair": {"name": "tempest-keypair-463056679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDil0Kh5W1juSxcUeaf3gGdUMqNWzqTFdgidoKcrKFIhiHTQrHF2gfQ/STJgojKvJtru5wtoyKFPVmPlQqJRy8IDFWqsLlfSks7+QCMi9wSdS+/FetauZE2c0nvdihlvIQ=="}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:06.831323 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-654b7a2e-c88a-4072-bb47-d0dc6274e42a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Getting quotas for project d2d97457b5cc4100a1ca1685f4c371e5. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:06.835716 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-654b7a2e-c88a-4072-bb47-d0dc6274e42a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Getting quotas for user 42ad8df34f8e405792afe94b91382122 and project d2d97457b5cc4100a1ca1685f4c371e5. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:06.858402 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-654b7a2e-c88a-4072-bb47-d0dc6274e42a tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047793 Aug 24 04:54:06.859136 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 338/732] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:54:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:07.308350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:07.309169 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:07.316230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:07.316719 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:07.317144 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:07.317858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:07.318352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:07.318777 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:07.339622 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] HTTP exception thrown: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Request method failure captured: Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 HTTP/1.1 Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa2-dv_RSTvS9FBpHzeP2CzRLbMD7v0dVmVxdh4x6CRpV_KFHKSGGgk2QjGl1m3hEuFmxUewyn49FrdYx40xz2fXvv_PwbYqy0m5ta9OaWHHUFdtjLVA5u7d-OXZog9CwkOX6GdZcJYoz5A9Sb07caa_T2UO5FKJryHSfaU_MK_rfWQ Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:54:07.341784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_02571d09157b409a8bd4737acd07c5de"}]}] Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 7c5112136c7947e3ac99949d330ba0be Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:54:07.343650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '5eeaea49-9c15-4e0a-a446-98d3191293c8'} Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:07.345813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:54:07.347764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.349156 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Returning 404 to user: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:07.349156 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8dc80d26-d301-421e-91d4-df937efa0b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 404 len: 111 microversion: 2.20 time: 0.040067 Aug 24 04:54:07.349156 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 395/733] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:07 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:54:07.355018 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-937ee421-e14a-47d0-afc2-2f52949c4cdb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '.version_select at 0x7fb050900d30>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:07.383876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-937ee421-e14a-47d0-afc2-2f52949c4cdb tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969204994" status: 204 len: 0 microversion: 2.20 time: 0.033724 Aug 24 04:54:07.384760 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 339/734] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Aug 24 04:54:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969204994 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 04:54:08.376012 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4d2f6feb-ec67-4423-b278-901512368866 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'create', calling method: .version_select at 0x7fb043f8dc10>, body: {"keypair": {"name": "tempest-keypair-621953616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXalTPqO4Xb1qS6DkTA8+6jYzufO9u+ASy5GF2RTAhB1uHTxsYWbhSJeKraK16BDQZKJ2sURsL0do3/KUlZRjrXMZlC9d9J/9WR6PZL6WAWsSGa75SF4tRTSz1NHV0cgQ=="}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:08.392055 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-4d2f6feb-ec67-4423-b278-901512368866 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Getting quotas for project 02571d09157b409a8bd4737acd07c5de. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:08.396470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-4d2f6feb-ec67-4423-b278-901512368866 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Getting quotas for user 7c5112136c7947e3ac99949d330ba0be and project 02571d09157b409a8bd4737acd07c5de. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:08.423951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4d2f6feb-ec67-4423-b278-901512368866 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051841 Aug 24 04:54:08.424709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 396/735] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Aug 24 04:54:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 04:54:08.811681 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1837836471", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f29fec8-6960-4724-afc6-f75ed363894e"}], "security_groups": [{"name": "tempest-securitygroup--2040811423"}], "key_name": "tempest-keypair-463056679", "user_data": "}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:08.940272 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] validate_networks() for [('5f29fec8-6960-4724-afc6-f75ed363894e', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:54:09.412116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:54:09.412537 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:54:09.413114 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:54:09.413546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:54:09.413939 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:54:09.422898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:09.423377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:09.423838 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:09.424532 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:09.424983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:09.425401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:09.444393 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Getting quotas for project d2d97457b5cc4100a1ca1685f4c371e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:09.448509 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Getting quotas for user 42ad8df34f8e405792afe94b91382122 and project d2d97457b5cc4100a1ca1685f4c371e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:09.459514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:54:09.462592 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:54:09.514550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ec52ccfa-d35f-44bb-8aa3-b181aa47d265 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.769749 Aug 24 04:54:09.515574 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 340/736] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:54:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 04:54:09.527791 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5edf6ac4-20f0-4ad7-8c43-794e80e4eee3 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:09.528386 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5edf6ac4-20f0-4ad7-8c43-794e80e4eee3 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:09.605376 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5edf6ac4-20f0-4ad7-8c43-794e80e4eee3 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:09.613013 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5edf6ac4-20f0-4ad7-8c43-794e80e4eee3 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1237 microversion: 2.1 time: 0.089627 Aug 24 04:54:09.613812 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 397/737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:09 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:10.072561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1495205236", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "821e5cbb-91e0-4e54-aa76-326181a39890"}], "security_groups": [{"name": "tempest-securitygroup--1696936739"}], "key_name": "tempest-keypair-621953616", "user_data": "}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:10.184851 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] validate_networks() for [('821e5cbb-91e0-4e54-aa76-326181a39890', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:54:10.596639 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:54:10.597068 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:54:10.597543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:54:10.597953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:54:10.598425 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:54:10.608082 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:10.608570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:10.609004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:10.609726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:10.610209 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:10.610632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:10.629890 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Getting quotas for project 02571d09157b409a8bd4737acd07c5de. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:10.634311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Getting quotas for user 7c5112136c7947e3ac99949d330ba0be and project 02571d09157b409a8bd4737acd07c5de. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:10.634750 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:10.635370 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:10.641839 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:10.642928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:10.643357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:10.644072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:10.644534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:10.645072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:10.649069 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:54:10.651359 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:54:10.664101 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:10.725449 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:10.734807 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-fb91764e-4c1d-4814-b9dc-ed8cec9f3a85 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.667965 Aug 24 04:54:10.736118 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 341/738] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Aug 24 04:54:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 04:54:10.744241 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-61861afb-7304-4679-9134-371342654173 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1289 microversion: 2.1 time: 0.112572 Aug 24 04:54:10.759899 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 398/739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:10 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:10.760023 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bd91c513-da1d-4298-91c3-564d725402fe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:10.760023 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bd91c513-da1d-4298-91c3-564d725402fe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:10.832149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bd91c513-da1d-4298-91c3-564d725402fe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:10.842987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bd91c513-da1d-4298-91c3-564d725402fe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:10.844648 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bd91c513-da1d-4298-91c3-564d725402fe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:10.845745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bd91c513-da1d-4298-91c3-564d725402fe tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1281 microversion: 2.20 time: 0.094954 Aug 24 04:54:10.854329 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 342/740] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:10 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:11.767830 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:11.769122 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:11.775685 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:11.782610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:11.783070 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:11.783817 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:11.788505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:11.789000 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:11.874284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:11.875493 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:11.889108 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:11.890243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:11.891246 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:11.893017 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:11.893848 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:11.894523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:12.014233 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:12.026845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:12.028899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:12.031665 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0b3f6bcd-b0b3-4cbc-9f83-27b05f11a145 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1351 microversion: 2.20 time: 0.167246 Aug 24 04:54:12.033611 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 343/741] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:11 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:12.138201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:12.146855 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a36bad25-b453-4754-8f0e-93d88a13ab9e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1363 microversion: 2.1 time: 0.382567 Aug 24 04:54:12.148343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 399/742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:11 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:12.471493 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-3a90c3cc-ab4c-4d73-8769-1f4227675fee req-f631c86e-51c7-488d-8ded-7316d9e700f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a820ec55-b7ec-42ee-926e-259580e5df2b", "tag": "a0efb7f9-c264-4d80-88ee-44bc06fec7d8"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:12.487269 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-3a90c3cc-ab4c-4d73-8769-1f4227675fee req-f631c86e-51c7-488d-8ded-7316d9e700f0 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:12.488278 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-3a90c3cc-ab4c-4d73-8769-1f4227675fee req-f631c86e-51c7-488d-8ded-7316d9e700f0 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:12.488653 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-3a90c3cc-ab4c-4d73-8769-1f4227675fee req-f631c86e-51c7-488d-8ded-7316d9e700f0 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:12.503240 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-3a90c3cc-ab4c-4d73-8769-1f4227675fee req-f631c86e-51c7-488d-8ded-7316d9e700f0 service nova] Creating event network-changed:a0efb7f9-c264-4d80-88ee-44bc06fec7d8 for instance a820ec55-b7ec-42ee-926e-259580e5df2b on hv-cinder-85426 Aug 24 04:54:12.513221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-3a90c3cc-ab4c-4d73-8769-1f4227675fee req-f631c86e-51c7-488d-8ded-7316d9e700f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045711 Aug 24 04:54:12.515045 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 344/743] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:13.056934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:13.057537 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:13.065958 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:13.066484 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:13.067108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:13.067811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:13.068437 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:13.068864 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:13.177023 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:13.179805 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:13.196199 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:13.197267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:13.197919 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:13.199222 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:13.200100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:13.200977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:13.237836 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:13.253369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:13.256146 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:13.258150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9437260f-a2eb-4536-903e-b1cde936ded6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1407 microversion: 2.20 time: 0.205477 Aug 24 04:54:13.260030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 400/744] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:13 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:13.375509 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:13.384141 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-892f5237-7f0a-4aee-849b-714a4848fb36 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1363 microversion: 2.1 time: 0.216520 Aug 24 04:54:13.385130 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 345/745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:13 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:13.431494 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-3a3848c1-1765-4fc6-b16f-d1ea309e7985 req-3fc51232-1b7f-47cb-8c16-396c5c4538f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25850e86-d01f-489f-b7be-a04e7854041b", "tag": "c95760a7-3a19-4223-bc23-f813a2768a06"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:13.442157 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-3a3848c1-1765-4fc6-b16f-d1ea309e7985 req-3fc51232-1b7f-47cb-8c16-396c5c4538f0 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:13.442721 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-3a3848c1-1765-4fc6-b16f-d1ea309e7985 req-3fc51232-1b7f-47cb-8c16-396c5c4538f0 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:13.443281 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-3a3848c1-1765-4fc6-b16f-d1ea309e7985 req-3fc51232-1b7f-47cb-8c16-396c5c4538f0 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:13.446383 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:13.456119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-3a3848c1-1765-4fc6-b16f-d1ea309e7985 req-3fc51232-1b7f-47cb-8c16-396c5c4538f0 service nova] Creating event network-changed:c95760a7-3a19-4223-bc23-f813a2768a06 for instance 25850e86-d01f-489f-b7be-a04e7854041b on hv-cinder-85426 Aug 24 04:54:13.462751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-3a3848c1-1765-4fc6-b16f-d1ea309e7985 req-3fc51232-1b7f-47cb-8c16-396c5c4538f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035164 Aug 24 04:54:13.463344 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 401/746] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:14.284954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:14.285527 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:14.295190 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:14.296071 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:14.296414 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:14.297132 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:14.297637 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:14.298096 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:14.302953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:14.406538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:14.407608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:14.415567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:14.416109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:14.416668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:14.417467 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:14.418119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:14.418777 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:14.592497 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:14.602648 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:14.604419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:14.605612 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f0081b53-0a96-4965-8cb5-4c7b40ea6528 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1407 microversion: 2.20 time: 0.324804 Aug 24 04:54:14.606232 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 346/747] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:14 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:14.669414 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:14.677444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1a83530b-eb12-4f71-a3aa-d17e7e453f46 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1363 microversion: 2.1 time: 0.276138 Aug 24 04:54:14.678158 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 402/748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:14 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:15.642106 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:15.642900 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:15.650493 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.650980 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.651447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:15.652149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.652602 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.653023 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:15.701503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:15.702533 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:15.709651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.710197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.710641 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:15.711927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.711927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.712321 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:16.096705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:16.106305 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:16.107836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:16.108799 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:16.108941 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-32632faf-3463-48cf-aede-b22b7cd429f7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1407 microversion: 2.20 time: 0.470969 Aug 24 04:54:16.109506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 347/749] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:15 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:16.117381 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-892d7ef5-2e5a-494d-a6e3-72aafec01738 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1363 microversion: 2.1 time: 0.421559 Aug 24 04:54:16.117973 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 403/750] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:15 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:17.131212 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:17.132250 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:17.137120 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:17.138039 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:17.139012 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:17.139735 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:17.140623 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:17.141421 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:17.142079 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:17.142767 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:17.145496 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:17.145983 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:17.147288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:17.148332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:17.148797 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:17.149218 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:17.374827 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:17.378027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:17.382641 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6d908d6b-2b7d-4d9c-be77-fe04609ad7ca tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1363 microversion: 2.1 time: 0.249481 Aug 24 04:54:17.383244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 404/751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:17 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:17.386742 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:17.388108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-718390a4-dbfe-4269-87a4-f65ccc84908a req-37680fcb-fdc8-4b81-a9b8-60bb778f066c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a820ec55-b7ec-42ee-926e-259580e5df2b", "name": "network-vif-plugged", "status": "completed", "tag": "a0efb7f9-c264-4d80-88ee-44bc06fec7d8"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:17.388656 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:17.389937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d782b975-e8bd-415e-80c9-9358250be858 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1407 microversion: 2.20 time: 0.262693 Aug 24 04:54:17.390697 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 348/752] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:17 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:17.398420 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-718390a4-dbfe-4269-87a4-f65ccc84908a req-37680fcb-fdc8-4b81-a9b8-60bb778f066c service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:17.398890 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-718390a4-dbfe-4269-87a4-f65ccc84908a req-37680fcb-fdc8-4b81-a9b8-60bb778f066c service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:17.399316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-718390a4-dbfe-4269-87a4-f65ccc84908a req-37680fcb-fdc8-4b81-a9b8-60bb778f066c service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:17.411184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-718390a4-dbfe-4269-87a4-f65ccc84908a req-37680fcb-fdc8-4b81-a9b8-60bb778f066c service nova] Creating event network-vif-plugged:a0efb7f9-c264-4d80-88ee-44bc06fec7d8 for instance a820ec55-b7ec-42ee-926e-259580e5df2b on hv-cinder-85426 Aug 24 04:54:17.416502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-718390a4-dbfe-4269-87a4-f65ccc84908a req-37680fcb-fdc8-4b81-a9b8-60bb778f066c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032015 Aug 24 04:54:17.417095 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 405/753] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:18.404830 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:18.405415 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:18.412016 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:18.413026 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:18.413458 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.414177 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:18.414326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:18.414764 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:18.415029 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.415134 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:18.421412 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:18.421904 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:18.422374 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.423162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:18.423533 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:18.423956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.619014 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:18.622698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:18.627067 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7462423c-0729-4583-aa95-a70049dc6071 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1363 microversion: 2.1 time: 0.226021 Aug 24 04:54:18.627642 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 349/754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:18 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:18.631134 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:18.633027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:18.634327 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a1bfcf71-4d5e-4280-b834-9443403b80a3 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1407 microversion: 2.20 time: 0.225427 Aug 24 04:54:18.635030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 406/755] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:18 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:54:19.430438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-ba1b7d83-9fe0-4594-9445-d009b45676b4 req-67636e94-8b3e-4abc-ad2f-70d6ae754942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25850e86-d01f-489f-b7be-a04e7854041b", "name": "network-vif-plugged", "status": "completed", "tag": "c95760a7-3a19-4223-bc23-f813a2768a06"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:19.439802 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-ba1b7d83-9fe0-4594-9445-d009b45676b4 req-67636e94-8b3e-4abc-ad2f-70d6ae754942 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.440276 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-ba1b7d83-9fe0-4594-9445-d009b45676b4 req-67636e94-8b3e-4abc-ad2f-70d6ae754942 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.440781 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-ba1b7d83-9fe0-4594-9445-d009b45676b4 req-67636e94-8b3e-4abc-ad2f-70d6ae754942 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:19.451535 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-ba1b7d83-9fe0-4594-9445-d009b45676b4 req-67636e94-8b3e-4abc-ad2f-70d6ae754942 service nova] Creating event network-vif-plugged:c95760a7-3a19-4223-bc23-f813a2768a06 for instance 25850e86-d01f-489f-b7be-a04e7854041b on hv-cinder-85426 Aug 24 04:54:19.456119 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-ba1b7d83-9fe0-4594-9445-d009b45676b4 req-67636e94-8b3e-4abc-ad2f-70d6ae754942 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029417 Aug 24 04:54:19.456709 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 350/756] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:19.650904 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:19.651482 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:19.656285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=6 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:19.660187 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:19.660573 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.661320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:19.661654 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.662223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:19.664684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.665988 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.666450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:19.669415 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.670204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.671046 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:19.671971 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.672591 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.673028 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:19.925738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:19.934379 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-96167b13-1d7f-4f33-be54-3bf699640530 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1549 microversion: 2.1 time: 0.288952 Aug 24 04:54:19.935300 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 407/757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:19 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1549 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:19.948707 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:19.955256 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ce1cb791-7ef0-463e-8d32-575b21114d2c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:19.955756 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ce1cb791-7ef0-463e-8d32-575b21114d2c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:19.958948 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:19.961540 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:19.962696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce1cb791-7ef0-463e-8d32-575b21114d2c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.962854 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-cdb6d2f4-8cea-4b02-ac76-04425316bbd8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1407 microversion: 2.20 time: 0.307369 Aug 24 04:54:19.963070 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce1cb791-7ef0-463e-8d32-575b21114d2c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.964091 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce1cb791-7ef0-463e-8d32-575b21114d2c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:19.964247 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 351/758] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:19 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:19.964387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce1cb791-7ef0-463e-8d32-575b21114d2c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.964848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce1cb791-7ef0-463e-8d32-575b21114d2c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.965268 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce1cb791-7ef0-463e-8d32-575b21114d2c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:20.045048 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ce1cb791-7ef0-463e-8d32-575b21114d2c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093601 Aug 24 04:54:20.045652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 408/759] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 24 04:54:19 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:20.986236 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:20.986982 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:20.989806 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:20.992716 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=18 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:21.000328 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:21.000836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:21.001298 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:21.002305 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:21.002773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:21.003715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:21.072764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-f4b7b604-9722-42e8-8546-3bde6adff2dd req-84d5687c-ed89-4d47-8ec7-aa2f071938e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a820ec55-b7ec-42ee-926e-259580e5df2b", "tag": "a0efb7f9-c264-4d80-88ee-44bc06fec7d8"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:21.096588 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-f4b7b604-9722-42e8-8546-3bde6adff2dd req-84d5687c-ed89-4d47-8ec7-aa2f071938e8 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:21.097282 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-f4b7b604-9722-42e8-8546-3bde6adff2dd req-84d5687c-ed89-4d47-8ec7-aa2f071938e8 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:21.098523 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-f4b7b604-9722-42e8-8546-3bde6adff2dd req-84d5687c-ed89-4d47-8ec7-aa2f071938e8 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:21.110889 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-f4b7b604-9722-42e8-8546-3bde6adff2dd req-84d5687c-ed89-4d47-8ec7-aa2f071938e8 service nova] Creating event network-changed:a0efb7f9-c264-4d80-88ee-44bc06fec7d8 for instance a820ec55-b7ec-42ee-926e-259580e5df2b on hv-cinder-85426 Aug 24 04:54:21.116471 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-f4b7b604-9722-42e8-8546-3bde6adff2dd req-84d5687c-ed89-4d47-8ec7-aa2f071938e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115701 Aug 24 04:54:21.117338 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 409/760] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:21.191740 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:21.201437 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:21.202953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:21.204052 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3ea85934-5abe-49a0-9835-2e32a4fbbf23 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1407 microversion: 2.20 time: 0.221939 Aug 24 04:54:21.204833 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 352/761] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:20 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:22.227577 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:22.228456 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:22.237634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:22.238235 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:22.238681 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:22.239433 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:22.239885 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:22.240655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:22.377910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:22.386149 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:22.387637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:22.388776 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b5654100-6313-4ae1-b8ab-632626095502 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1599 microversion: 2.20 time: 0.165975 Aug 24 04:54:22.389329 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 410/762] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:54:22 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:22.411652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-62af6ca4-5477-4e45-8d5b-b2d768fce48f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:22.413416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-62af6ca4-5477-4e45-8d5b-b2d768fce48f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:22.419261 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62af6ca4-5477-4e45-8d5b-b2d768fce48f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:22.419742 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62af6ca4-5477-4e45-8d5b-b2d768fce48f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:22.420174 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62af6ca4-5477-4e45-8d5b-b2d768fce48f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:22.420865 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62af6ca4-5477-4e45-8d5b-b2d768fce48f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:22.421317 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62af6ca4-5477-4e45-8d5b-b2d768fce48f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:22.421739 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-62af6ca4-5477-4e45-8d5b-b2d768fce48f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:22.505065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-62af6ca4-5477-4e45-8d5b-b2d768fce48f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097254 Aug 24 04:54:22.505671 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 353/763] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Aug 24 04:54:22 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:54:23.446634 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-da7753d4-80da-47a3-854a-71c43238ed7c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:23.447191 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-da7753d4-80da-47a3-854a-71c43238ed7c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:23.453360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-da7753d4-80da-47a3-854a-71c43238ed7c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:23.453921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-da7753d4-80da-47a3-854a-71c43238ed7c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:23.454395 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-da7753d4-80da-47a3-854a-71c43238ed7c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:23.455086 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-da7753d4-80da-47a3-854a-71c43238ed7c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:23.455535 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-da7753d4-80da-47a3-854a-71c43238ed7c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:23.455951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-da7753d4-80da-47a3-854a-71c43238ed7c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:23.481149 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-da7753d4-80da-47a3-854a-71c43238ed7c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/ips" status: 200 len: 150 microversion: 2.1 time: 0.142169 Aug 24 04:54:23.481950 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 411/764] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:54:23 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/ips => generated 150 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:23.704422 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-7fc29e62-60ad-4a3e-9443-5723162ed120 req-1c4f2ef5-6652-4a7f-b58b-c5420bfd0f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25850e86-d01f-489f-b7be-a04e7854041b", "tag": "c95760a7-3a19-4223-bc23-f813a2768a06"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:23.731561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7fc29e62-60ad-4a3e-9443-5723162ed120 req-1c4f2ef5-6652-4a7f-b58b-c5420bfd0f6b service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:23.731762 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7fc29e62-60ad-4a3e-9443-5723162ed120 req-1c4f2ef5-6652-4a7f-b58b-c5420bfd0f6b service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:23.732195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7fc29e62-60ad-4a3e-9443-5723162ed120 req-1c4f2ef5-6652-4a7f-b58b-c5420bfd0f6b service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:23.760632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-7fc29e62-60ad-4a3e-9443-5723162ed120 req-1c4f2ef5-6652-4a7f-b58b-c5420bfd0f6b service nova] Creating event network-changed:c95760a7-3a19-4223-bc23-f813a2768a06 for instance 25850e86-d01f-489f-b7be-a04e7854041b on hv-cinder-85426 Aug 24 04:54:23.765390 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-7fc29e62-60ad-4a3e-9443-5723162ed120 req-1c4f2ef5-6652-4a7f-b58b-c5420bfd0f6b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065526 Aug 24 04:54:23.766480 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 354/765] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:24.886453 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d2594702-f896-4243-a877-bcfe6b377624 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62d58b26-481d-417a-8144-d57a469c76bd"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:24.888967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d2594702-f896-4243-a877-bcfe6b377624 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:24.896071 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2594702-f896-4243-a877-bcfe6b377624 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:24.897064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2594702-f896-4243-a877-bcfe6b377624 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:24.897489 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2594702-f896-4243-a877-bcfe6b377624 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:24.898452 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2594702-f896-4243-a877-bcfe6b377624 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:24.898909 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2594702-f896-4243-a877-bcfe6b377624 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:24.899328 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2594702-f896-4243-a877-bcfe6b377624 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:25.152808 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d2594702-f896-4243-a877-bcfe6b377624 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270174 Aug 24 04:54:25.153414 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 412/766] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:54:24 2022] POST /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:32.696513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62d58b26-481d-417a-8144-d57a469c76bd"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:32.699030 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:32.706219 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:32.706741 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:32.707167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:32.707867 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:32.708313 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:32.708731 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:32.800285 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Invalid volume: volume 62d58b26-481d-417a-8144-d57a469c76bd is already attached to instances: a0b95f69-cad3-4702-ae63-d4236e2d414c Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: POST /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments HTTP/1.1 Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 74 Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:54:32.801925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {"volumeAttachment": {"volumeId": "62d58b26-481d-417a-8144-d57a469c76bd"}} Aug 24 04:54:32.803578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Invalid volume: volume 62d58b26-481d-417a-8144-d57a469c76bd is already attached to instances: a0b95f69-cad3-4702-ae63-d4236e2d414c Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'server_id': 'a0b95f69-cad3-4702-ae63-d4236e2d414c', 'body': {'volumeAttachment': {'volumeId': '62d58b26-481d-417a-8144-d57a469c76bd'}}} Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 62d58b26-481d-417a-8144-d57a469c76bd is already attached to instances: a0b95f69-cad3-4702-ae63-d4236e2d414c Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:54:32.805320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 62d58b26-481d-417a-8144-d57a469c76bd is already attached to instances: a0b95f69-cad3-4702-ae63-d4236e2d414c Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:32.806886 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:32.808523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:32.808523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:32.808523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:32.808523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 62d58b26-481d-417a-8144-d57a469c76bd is already attached to instances: a0b95f69-cad3-4702-ae63-d4236e2d414c Aug 24 04:54:32.808523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:54:32.808523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 400 to user: Invalid volume: volume 62d58b26-481d-417a-8144-d57a469c76bd is already attached to instances: a0b95f69-cad3-4702-ae63-d4236e2d414c {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:32.808523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3e7aa934-aaae-40fd-94b3-daa2b1206806 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111414 Aug 24 04:54:32.808523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 355/767] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:54:32 2022] POST /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:54:32.869891 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:32.870518 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:32.872446 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:32.877891 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:32.878407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:32.878846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:32.879541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:32.879997 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:32.880419 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:32.965848 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lazy-loading 'services' on Instance uuid a0b95f69-cad3-4702-ae63-d4236e2d414c {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:54:33.041232 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f67dd671-6a80-4b7d-9fc2-cb134f2a4ebb tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments/62d58b26-481d-417a-8144-d57a469c76bd" status: 202 len: 0 microversion: 2.1 time: 0.176542 Aug 24 04:54:33.041812 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 413/768] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:54:32 2022] DELETE /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments/62d58b26-481d-417a-8144-d57a469c76bd => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:54:33.050128 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-14c54b4f-da06-4947-86ea-cf15b95a014c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:33.052407 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-14c54b4f-da06-4947-86ea-cf15b95a014c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:33.059632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14c54b4f-da06-4947-86ea-cf15b95a014c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:33.060119 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14c54b4f-da06-4947-86ea-cf15b95a014c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:33.060600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14c54b4f-da06-4947-86ea-cf15b95a014c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:33.061341 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14c54b4f-da06-4947-86ea-cf15b95a014c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:33.061821 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14c54b4f-da06-4947-86ea-cf15b95a014c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:33.062265 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-14c54b4f-da06-4947-86ea-cf15b95a014c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:33.095237 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-14c54b4f-da06-4947-86ea-cf15b95a014c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049017 Aug 24 04:54:33.095793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 356/769] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:33 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:34.110346 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d53b5f1b-cff3-4bab-91f3-6fc31ab8291b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:34.112637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d53b5f1b-cff3-4bab-91f3-6fc31ab8291b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:34.119614 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d53b5f1b-cff3-4bab-91f3-6fc31ab8291b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.120127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d53b5f1b-cff3-4bab-91f3-6fc31ab8291b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.120558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d53b5f1b-cff3-4bab-91f3-6fc31ab8291b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.121256 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d53b5f1b-cff3-4bab-91f3-6fc31ab8291b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.121706 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d53b5f1b-cff3-4bab-91f3-6fc31ab8291b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.122152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d53b5f1b-cff3-4bab-91f3-6fc31ab8291b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.154299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d53b5f1b-cff3-4bab-91f3-6fc31ab8291b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048679 Aug 24 04:54:34.154877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 414/770] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:34 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:54:34.216848 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:34.217365 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:34.223830 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.224303 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.224738 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.225419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.225869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.226308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.251844 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Going to try to terminate instance {{(pid=127416) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:54:34.328985 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3481cb3a-5190-41ac-b32b-f807ca37fb7e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 204 len: 0 microversion: 2.1 time: 0.115655 Aug 24 04:54:34.329572 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 357/771] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:54:34 2022] DELETE /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:54:34.338262 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:34.338867 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:34.344854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.345328 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.345754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.346468 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.346914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.347330 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.486483 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:34.495234 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-508eef14-3a54-4504-8ca1-dddfca7b7317 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1680 microversion: 2.1 time: 0.161188 Aug 24 04:54:34.495807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 415/772] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:34 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:35.517310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:35.517911 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:35.525420 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.526025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.526477 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.527358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.527874 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.528258 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.663414 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:35.671266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5c8235c1-e182-48cc-8bc1-8a8dac71f55d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1680 microversion: 2.1 time: 0.158497 Aug 24 04:54:35.671821 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 358/773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:35 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:36.701075 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:36.701764 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:36.712898 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.713429 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.714747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:36.715612 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.716092 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.716745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:36.935860 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:36.945075 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7460d101-56d1-473d-88b1-4645e19dbb37 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 200 len: 1680 microversion: 2.1 time: 0.254787 Aug 24 04:54:36.945966 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 416/774] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:36 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:37.264058 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-c1d56702-986a-4e5b-99d3-f88362a0d4fd req-46cedeac-bd5c-40de-9642-98908bf6b52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b95f69-cad3-4702-ae63-d4236e2d414c", "name": "network-vif-deleted", "tag": "8c928cbe-9d51-4cfe-be31-9ab8a69c1530"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:37.276070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-c1d56702-986a-4e5b-99d3-f88362a0d4fd req-46cedeac-bd5c-40de-9642-98908bf6b52b service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:37.276632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-c1d56702-986a-4e5b-99d3-f88362a0d4fd req-46cedeac-bd5c-40de-9642-98908bf6b52b service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:37.277061 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-c1d56702-986a-4e5b-99d3-f88362a0d4fd req-46cedeac-bd5c-40de-9642-98908bf6b52b service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:37.291412 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-c1d56702-986a-4e5b-99d3-f88362a0d4fd req-46cedeac-bd5c-40de-9642-98908bf6b52b service nova] Creating event network-vif-deleted:8c928cbe-9d51-4cfe-be31-9ab8a69c1530 for instance a0b95f69-cad3-4702-ae63-d4236e2d414c on hv-cinder-85426 Aug 24 04:54:37.300772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-c1d56702-986a-4e5b-99d3-f88362a0d4fd req-46cedeac-bd5c-40de-9642-98908bf6b52b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040144 Aug 24 04:54:37.301877 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 359/775] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:37.967102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:37.967716 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:37.975418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:37.975867 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:37.976309 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:37.977132 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:37.977581 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:37.978240 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:37.992543 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c HTTP/1.1 Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:54:37.994273 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:54:37.995556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': 'a0b95f69-cad3-4702-ae63-d4236e2d414c'} Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:37.996348 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:54:37.997740 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:37.999056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:37.999056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3fee2f98-69b9-4680-bb51-9cff018f09c7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 404 len: 111 microversion: 2.1 time: 0.032665 Aug 24 04:54:37.999056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 417/776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:37 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:38.005282 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bb9d26fb-733c-44c9-b31c-ade96d8d4afa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '.version_select at 0x7fb050900e50>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:38.028436 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bb9d26fb-733c-44c9-b31c-ade96d8d4afa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472267010" status: 202 len: 0 microversion: 2.1 time: 0.027394 Aug 24 04:54:38.029020 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 360/777] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 24 04:54:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472267010 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:54:38.673108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5e6b944f-c687-4387-bff8-52722c1bf593 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: .version_select at 0x7fb043fa8c10>, body: {"keypair": {"name": "tempest-keypair-615035593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIdPkV+VisZTl/iv3tZplK9B7tpaftzBI+1G45hn7oL6oH35y+g4QIaA5DwZuRWF5kI2yhzpXZAGGrPlkzdHdnFZ8EubMx/CujufQb5toROUOlydOQR5xj0zntyz7s5A=="}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:38.689171 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-5e6b944f-c687-4387-bff8-52722c1bf593 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:38.692982 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-5e6b944f-c687-4387-bff8-52722c1bf593 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for user b847f94abee2439fab2f85f48abd7707 and project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'key_pairs'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:38.716392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5e6b944f-c687-4387-bff8-52722c1bf593 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047070 Aug 24 04:54:38.716989 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 418/778] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:54:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:40.027153 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1657194894", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bc1ad55-5d65-47b3-8be9-9d83a75436be"}], "security_groups": [{"name": "tempest-securitygroup--7864048"}], "key_name": "tempest-keypair-615035593", "user_data": "}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:40.143059 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] validate_networks() for [('5bc1ad55-5d65-47b3-8be9-9d83a75436be', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:54:40.573837 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:54:40.574287 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:54:40.574785 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:54:40.575195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:54:40.575604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:54:40.584908 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:40.585382 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:40.585810 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:40.586562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:40.587007 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:40.587418 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:40.606118 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:40.610577 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Getting quotas for user b847f94abee2439fab2f85f48abd7707 and project 1e9c64fe66a8438eb31c22925ff62994. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:40.623444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:54:40.625864 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:54:40.680726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-85329891-44cd-4934-83b4-fca5059731f9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.658025 Aug 24 04:54:40.681399 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 361/779] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:54:40 2022] POST /compute/v2.1/servers => generated 399 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:54:40.694538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0e5939c0-1604-41a7-be85-60dd486ac8fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:40.696117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0e5939c0-1604-41a7-be85-60dd486ac8fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:40.757925 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0e5939c0-1604-41a7-be85-60dd486ac8fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:40.764931 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0e5939c0-1604-41a7-be85-60dd486ac8fc tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1241 microversion: 2.1 time: 0.075414 Aug 24 04:54:40.765491 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 419/780] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:40 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:41.777812 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:41.778488 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:41.780375 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:41.786790 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:41.787283 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:41.788174 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:41.789306 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:41.789846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:41.790120 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:41.791094 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:41.799970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:41.800722 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:41.800858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:41.801230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:41.801940 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:41.802430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:41.802960 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:41.898393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:41.912744 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lazy-loading 'services' on Instance uuid 15409608-f562-4e3c-af4c-e918e3f5921b {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:54:41.914072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8e3fd77b-f680-409c-9d30-576d37430b89 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1311 microversion: 2.1 time: 0.123921 Aug 24 04:54:41.915071 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 420/781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:41 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:41.993867 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bf49a84b-4f24-4215-83a2-685155f261cd tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "DELETE /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments/6e290423-7630-4511-92b1-f0db5d9c8baf" status: 202 len: 0 microversion: 2.1 time: 0.221305 Aug 24 04:54:41.994580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 362/782] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:54:41 2022] DELETE /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments/6e290423-7630-4511-92b1-f0db5d9c8baf => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:54:42.004939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-97e8577e-9c1b-45de-a397-14f81132d2fa tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:42.008286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-97e8577e-9c1b-45de-a397-14f81132d2fa tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:42.016590 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-97e8577e-9c1b-45de-a397-14f81132d2fa tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.017854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-97e8577e-9c1b-45de-a397-14f81132d2fa tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.018871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-97e8577e-9c1b-45de-a397-14f81132d2fa tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:42.019748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-97e8577e-9c1b-45de-a397-14f81132d2fa tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.020327 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-97e8577e-9c1b-45de-a397-14f81132d2fa tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.020838 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-97e8577e-9c1b-45de-a397-14f81132d2fa tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:42.023841 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:42.060521 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-97e8577e-9c1b-45de-a397-14f81132d2fa tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060360 Aug 24 04:54:42.061252 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 421/783] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:41 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:42.936208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:42.936962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:42.943349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.944754 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.945191 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:42.945905 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.946604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.947034 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.073515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0dfe07ec-8d84-4040-9168-1311a6c4b262 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:43.075949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0dfe07ec-8d84-4040-9168-1311a6c4b262 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:43.084102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dfe07ec-8d84-4040-9168-1311a6c4b262 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.084599 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dfe07ec-8d84-4040-9168-1311a6c4b262 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.085046 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dfe07ec-8d84-4040-9168-1311a6c4b262 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.085755 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dfe07ec-8d84-4040-9168-1311a6c4b262 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.086256 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dfe07ec-8d84-4040-9168-1311a6c4b262 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.086829 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dfe07ec-8d84-4040-9168-1311a6c4b262 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.119136 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0dfe07ec-8d84-4040-9168-1311a6c4b262 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050076 Aug 24 04:54:43.119791 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 422/784] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:43 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 04:54:43.195512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:43.205257 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ce708549-7ff3-41b6-b285-f05ac3baff62 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1364 microversion: 2.1 time: 0.273883 Aug 24 04:54:43.206386 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:43.206617 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 363/785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:42 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:43.207327 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:43.231116 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.231642 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.232114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.232839 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.233363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.233718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.261406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:54:43.363681 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d3f6fd66-10e1-4982-baa8-5b5fa91bca67 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "DELETE /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 204 len: 0 microversion: 2.1 time: 0.161337 Aug 24 04:54:43.364753 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 423/786] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:54:43 2022] DELETE /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:54:43.377728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:43.378628 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:43.385765 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.386032 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.386421 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.387161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.388413 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.388845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.388995 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-6f0fc7bd-7fc1-4a56-93a8-0ecc922b5f82 req-67516326-f29d-470f-8ae9-78b31a4450f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb4ee39-2853-46cf-8706-1763a7c6f91a", "tag": "c1d66fe8-b698-430e-b942-010dff2a7984"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:43.402523 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6f0fc7bd-7fc1-4a56-93a8-0ecc922b5f82 req-67516326-f29d-470f-8ae9-78b31a4450f9 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.403310 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6f0fc7bd-7fc1-4a56-93a8-0ecc922b5f82 req-67516326-f29d-470f-8ae9-78b31a4450f9 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.403929 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6f0fc7bd-7fc1-4a56-93a8-0ecc922b5f82 req-67516326-f29d-470f-8ae9-78b31a4450f9 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.410776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:43.427033 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-6f0fc7bd-7fc1-4a56-93a8-0ecc922b5f82 req-67516326-f29d-470f-8ae9-78b31a4450f9 service nova] Creating event network-changed:c1d66fe8-b698-430e-b942-010dff2a7984 for instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a on hv-cinder-85426 Aug 24 04:54:43.435812 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-6f0fc7bd-7fc1-4a56-93a8-0ecc922b5f82 req-67516326-f29d-470f-8ae9-78b31a4450f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056351 Aug 24 04:54:43.436433 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 424/787] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:43.547331 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:43.555900 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3bfdbb39-dde8-4fc3-8bfd-b7d9056920be tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1689 microversion: 2.1 time: 0.182284 Aug 24 04:54:43.556491 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 364/788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:43 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:44.228765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:44.229696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:44.236195 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.236671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.237100 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.237790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.238285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.238697 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.388267 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:44.397220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f151d8c9-3679-49ad-addc-56511934821d tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1364 microversion: 2.1 time: 0.173823 Aug 24 04:54:44.397834 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 425/789] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:44 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:44.578013 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:44.578624 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:44.586075 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.586564 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.587002 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.587827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.588286 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.588710 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.733378 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:44.742526 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c77e1018-4d67-44bf-8edf-04eae89e1ceb tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1689 microversion: 2.1 time: 0.168669 Aug 24 04:54:44.743115 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 365/790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:44 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:45.419369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:45.419888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:45.430117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.431005 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.431768 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.433032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.433855 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.434600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.583628 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:45.592658 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a4646315-a4be-451b-8cb0-c14e08f25f72 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1364 microversion: 2.1 time: 0.177181 Aug 24 04:54:45.593440 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 426/791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:45 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:45.764818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:45.765388 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:45.772342 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.773534 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.773971 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.774771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.775230 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.775651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.909697 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:45.918747 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-94fdcf07-9750-4cdf-a84a-3c29dafc564f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1689 microversion: 2.1 time: 0.158123 Aug 24 04:54:45.919333 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 366/792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:45 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:46.614883 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:46.615522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:46.622266 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.622680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.623126 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:46.623809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.624257 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.624673 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:46.787694 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:46.797418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-390e81d8-d589-4aea-8235-9daaf105a29e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1364 microversion: 2.1 time: 0.186337 Aug 24 04:54:46.797922 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 427/793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:46 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:46.941595 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:46.942482 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:46.950956 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.951456 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.952136 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:46.952917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.953364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.953870 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:47.183608 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:47.191607 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bf61794d-36ab-49c7-b4de-97521026ce98 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1689 microversion: 2.1 time: 0.253851 Aug 24 04:54:47.192204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 367/794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:46 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1689 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:47.820093 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:47.821631 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:47.828519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:47.829016 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:47.829457 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:47.830208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:47.830671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:47.831100 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.030552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:48.040671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-919effab-f4e7-43b0-9deb-34b9f4e56722 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1364 microversion: 2.1 time: 0.224952 Aug 24 04:54:48.041492 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 428/795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:47 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:48.112045 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-071a884f-8a11-46d5-91c1-2444c03ab309 req-fd901a44-721b-4e20-b27f-a4b82d298cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15409608-f562-4e3c-af4c-e918e3f5921b", "name": "network-vif-deleted", "tag": "3275601c-1146-4292-877e-cda074b8821f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:48.124326 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-071a884f-8a11-46d5-91c1-2444c03ab309 req-fd901a44-721b-4e20-b27f-a4b82d298cc2 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:48.125131 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-071a884f-8a11-46d5-91c1-2444c03ab309 req-fd901a44-721b-4e20-b27f-a4b82d298cc2 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:48.125578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-071a884f-8a11-46d5-91c1-2444c03ab309 req-fd901a44-721b-4e20-b27f-a4b82d298cc2 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.138818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-071a884f-8a11-46d5-91c1-2444c03ab309 req-fd901a44-721b-4e20-b27f-a4b82d298cc2 service nova] Creating event network-vif-deleted:3275601c-1146-4292-877e-cda074b8821f for instance 15409608-f562-4e3c-af4c-e918e3f5921b on hv-cinder-85426 Aug 24 04:54:48.144483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-071a884f-8a11-46d5-91c1-2444c03ab309 req-fd901a44-721b-4e20-b27f-a4b82d298cc2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100404 Aug 24 04:54:48.145102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 368/796] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:48.214676 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:48.215413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:48.222196 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:48.222699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:48.223136 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.224211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:48.224759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:48.225199 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.304790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:48.313538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-62a86de5-9d48-46c2-a8fe-3239d3777ce0 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 200 len: 1622 microversion: 2.1 time: 0.104502 Aug 24 04:54:48.314151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 429/797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:48 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 1622 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:49.063188 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:49.064018 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:49.073245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.074112 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.074683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.075503 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.076053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.076547 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.230450 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:49.239135 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-879a46f7-531d-4bfe-8148-1b6c24dcd87b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1364 microversion: 2.1 time: 0.181530 Aug 24 04:54:49.239714 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 369/798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:49 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:49.336126 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:49.336833 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 15409608-f562-4e3c-af4c-e918e3f5921b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:49.344378 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.344980 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.345425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.346174 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.346662 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.347084 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.362148 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] HTTP exception thrown: Instance 15409608-f562-4e3c-af4c-e918e3f5921b could not be found. Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Request method failure captured: Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b HTTP/1.1 Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa20IyEzD7U6F30SSskJS5-VXIlAQDQ0K19oWqsUTewrcIbAUWR7Aa4Zzl27820bwdwcAamNBDZvl1f_fj13FMS6YF8vnY0uVTe4hRADGrPARVoyHJZb11Pd6NwA_3kVyPjQEJcmGyj1ZzRHYY-6VD3wIiyVmXmgLBI9a6Fr0LxiYxo Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:54:49.364002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1a1f238eb4f34d44ac93b85181ad7001"}]}] Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 3d5408f9ada24654839e479c7fe385ce Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 15409608-f562-4e3c-af4c-e918e3f5921b could not be found. Aug 24 04:54:49.365620 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '15409608-f562-4e3c-af4c-e918e3f5921b'} Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15409608-f562-4e3c-af4c-e918e3f5921b could not be found. Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:49.367688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15409608-f562-4e3c-af4c-e918e3f5921b could not be found. Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15409608-f562-4e3c-af4c-e918e3f5921b could not be found. Aug 24 04:54:49.369138 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:49.370417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Returning 404 to user: Instance 15409608-f562-4e3c-af4c-e918e3f5921b could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:49.370417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8bd35735-149f-4e76-8b18-acefa6222f8e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b" status: 404 len: 111 microversion: 2.1 time: 0.033613 Aug 24 04:54:49.370417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 430/799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:49 2022] GET /compute/v2.1/servers/15409608-f562-4e3c-af4c-e918e3f5921b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:49.375438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b43caee8-a2a0-485b-bdb1-5c22556b8fd9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '.version_select at 0x7fb05091baf0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:49.395642 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b43caee8-a2a0-485b-bdb1-5c22556b8fd9 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202614937" status: 202 len: 0 microversion: 2.1 time: 0.024145 Aug 24 04:54:49.396355 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 370/800] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 24 04:54:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202614937 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:54:50.260079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:50.260710 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:50.268127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.268623 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.269075 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:50.269792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.270285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.270715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:50.417798 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:50.425834 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-68d906c0-13d7-4cc0-81d9-f875e3fad68b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1364 microversion: 2.1 time: 0.169650 Aug 24 04:54:50.426459 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 431/801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:50 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:51.190631 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:51.191587 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=6 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:51.295907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-6757e32e-fd2c-41fb-b680-7f357560c520 req-20dbab07-a512-4957-b39c-914d70e57cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb4ee39-2853-46cf-8706-1763a7c6f91a", "name": "network-vif-plugged", "status": "completed", "tag": "c1d66fe8-b698-430e-b942-010dff2a7984"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:51.312471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-6757e32e-fd2c-41fb-b680-7f357560c520 req-20dbab07-a512-4957-b39c-914d70e57cbb service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:51.313250 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-6757e32e-fd2c-41fb-b680-7f357560c520 req-20dbab07-a512-4957-b39c-914d70e57cbb service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:51.313675 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-6757e32e-fd2c-41fb-b680-7f357560c520 req-20dbab07-a512-4957-b39c-914d70e57cbb service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.326076 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-6757e32e-fd2c-41fb-b680-7f357560c520 req-20dbab07-a512-4957-b39c-914d70e57cbb service nova] Creating event network-vif-plugged:c1d66fe8-b698-430e-b942-010dff2a7984 for instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a on hv-cinder-85426 Aug 24 04:54:51.331606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-6757e32e-fd2c-41fb-b680-7f357560c520 req-20dbab07-a512-4957-b39c-914d70e57cbb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147852 Aug 24 04:54:51.332296 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 371/802] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:51.447549 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:51.448187 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:51.450398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=6 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:51.456992 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:51.457455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:51.457886 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.458616 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:51.459062 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:51.459483 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.615128 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:51.623395 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c38d645f-efb4-4228-9ba9-c304f3ab379c tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1364 microversion: 2.1 time: 0.180147 Aug 24 04:54:51.624161 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 432/803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:51 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:52.379201 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:52.379830 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:52.387237 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.387763 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.388265 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.388973 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.389477 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.390025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.417301 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Going to try to terminate instance {{(pid=127416) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:54:52.498423 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f3479ffa-dfb3-432d-8edd-a69cc99113c5 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "DELETE /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 204 len: 0 microversion: 2.1 time: 0.123773 Aug 24 04:54:52.499301 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 372/804] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:54:52 2022] DELETE /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:54:52.509212 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:52.509918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:52.516984 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.517536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.517971 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.518739 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.519197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.519782 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.647418 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:52.648287 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:52.657539 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.658402 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.658866 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.660025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.660280 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.660828 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.975948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:52.985206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-958974b4-c399-4156-9f78-d48d24f749b4 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1508 microversion: 2.1 time: 0.481376 Aug 24 04:54:52.985793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 433/805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:52 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:52.994246 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:53.002557 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9e59fed8-a367-4aed-add5-11aca531eeae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1364 microversion: 2.1 time: 0.359553 Aug 24 04:54:53.003135 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 373/806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:52 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1364 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:54.008614 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:54.009260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:54.016482 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.016974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.017415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.018202 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.018667 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.019428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.025374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:54.026027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:54.032138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.032621 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.033056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.033759 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.034238 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.034670 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.221337 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:54.230728 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-699a1113-e173-447b-86d6-50c3c65eb268 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1508 microversion: 2.1 time: 0.226620 Aug 24 04:54:54.231692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 434/807] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:54 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:54.234354 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:54.243666 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c3411fe5-2711-4447-9ec5-fb155dc58edf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1554 microversion: 2.1 time: 0.223109 Aug 24 04:54:54.244350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 374/808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:54 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:54.264222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-974e7720-f72f-4f60-a308-6dc03eb997c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:54.264626 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-974e7720-f72f-4f60-a308-6dc03eb997c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:54.270986 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-974e7720-f72f-4f60-a308-6dc03eb997c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.271464 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-974e7720-f72f-4f60-a308-6dc03eb997c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.271903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-974e7720-f72f-4f60-a308-6dc03eb997c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.272584 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-974e7720-f72f-4f60-a308-6dc03eb997c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.273027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-974e7720-f72f-4f60-a308-6dc03eb997c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.273444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-974e7720-f72f-4f60-a308-6dc03eb997c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.363010 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-974e7720-f72f-4f60-a308-6dc03eb997c9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102767 Aug 24 04:54:54.363600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 435/809] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 24 04:54:54 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:55.255653 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:55.257083 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:55.268534 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.269142 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.269687 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.270590 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.271111 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.271611 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.421230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-2a864cb0-ffe9-44f4-9138-5a2993a94282 req-25835785-c516-448f-9837-1f29f2a8ea96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f7e127-b04d-4dd0-ac98-8c566e17d6e1", "name": "network-vif-deleted", "tag": "0c800baa-57cc-40c6-bf82-bdd699f1f9d4"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:55.437203 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-2a864cb0-ffe9-44f4-9138-5a2993a94282 req-25835785-c516-448f-9837-1f29f2a8ea96 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.438524 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-2a864cb0-ffe9-44f4-9138-5a2993a94282 req-25835785-c516-448f-9837-1f29f2a8ea96 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.439209 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-2a864cb0-ffe9-44f4-9138-5a2993a94282 req-25835785-c516-448f-9837-1f29f2a8ea96 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.453867 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-2a864cb0-ffe9-44f4-9138-5a2993a94282 req-25835785-c516-448f-9837-1f29f2a8ea96 service nova] Creating event network-vif-deleted:0c800baa-57cc-40c6-bf82-bdd699f1f9d4 for instance 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 on hv-cinder-85426 Aug 24 04:54:55.459225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-2a864cb0-ffe9-44f4-9138-5a2993a94282 req-25835785-c516-448f-9837-1f29f2a8ea96 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043693 Aug 24 04:54:55.460826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 436/810] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:55.500470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:55.518324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b9a5b771-94ab-4bfc-a8a8-8768d6e09b7f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1466 microversion: 2.1 time: 0.268231 Aug 24 04:54:55.520100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 375/811] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:55 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1466 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:55.625649 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-5696c4c5-370d-4e8d-b643-13688008fbad req-48909a18-8bf4-43af-a93b-60fc15ec1e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb4ee39-2853-46cf-8706-1763a7c6f91a", "tag": "c1d66fe8-b698-430e-b942-010dff2a7984"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:55.646041 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-5696c4c5-370d-4e8d-b643-13688008fbad req-48909a18-8bf4-43af-a93b-60fc15ec1e2c service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.647798 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-5696c4c5-370d-4e8d-b643-13688008fbad req-48909a18-8bf4-43af-a93b-60fc15ec1e2c service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.648762 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-5696c4c5-370d-4e8d-b643-13688008fbad req-48909a18-8bf4-43af-a93b-60fc15ec1e2c service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.673062 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-5696c4c5-370d-4e8d-b643-13688008fbad req-48909a18-8bf4-43af-a93b-60fc15ec1e2c service nova] Creating event network-changed:c1d66fe8-b698-430e-b942-010dff2a7984 for instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a on hv-cinder-85426 Aug 24 04:54:55.683424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-5696c4c5-370d-4e8d-b643-13688008fbad req-48909a18-8bf4-43af-a93b-60fc15ec1e2c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064044 Aug 24 04:54:55.684596 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 437/812] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:56.551193 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:56.553341 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:56.560047 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.560606 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.561371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.563868 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.564526 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.565161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.601523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.601948 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.602614 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.603043 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lazy-loading 'fault' on Instance uuid 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:54:56.656333 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:56.665134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a281e694-9707-475e-ac60-01493c553f4e tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 200 len: 1311 microversion: 2.1 time: 0.117790 Aug 24 04:54:56.679630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 376/813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:56 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:57.689920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:57.690642 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: 99f7e127-b04d-4dd0-ac98-8c566e17d6e1] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:57.698069 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.698544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.698850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.699555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.700013 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.700431 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.715956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] HTTP exception thrown: Instance 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 could not be found. Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Request method failure captured: Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 HTTP/1.1 Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa20IyEzD7U6F30SSskJS5-VXIlAQDQ0K19oWqsUTewrcIbAUWR7Aa4Zzl27820bwdwcAamNBDZvl1f_fj13FMS6YF8vnY0uVTe4hRADGrPARVoyHJZb11Pd6NwA_3kVyPjQEJcmGyj1ZzRHYY-6VD3wIiyVmXmgLBI9a6Fr0LxiYxo Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:54:57.717602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1a1f238eb4f34d44ac93b85181ad7001"}]}] Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 3d5408f9ada24654839e479c7fe385ce Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 could not be found. Aug 24 04:54:57.720045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '99f7e127-b04d-4dd0-ac98-8c566e17d6e1'} Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 could not be found. Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:57.721351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 could not be found. Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 could not be found. Aug 24 04:54:57.723678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:54:57.726680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Returning 404 to user: Instance 99f7e127-b04d-4dd0-ac98-8c566e17d6e1 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:57.726680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-406bd80e-b361-412d-9c2c-f11ec3f10e7d tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1" status: 404 len: 111 microversion: 2.1 time: 0.033957 Aug 24 04:54:57.726680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 438/814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:57 2022] GET /compute/v2.1/servers/99f7e127-b04d-4dd0-ac98-8c566e17d6e1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:57.732936 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:57.734473 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:57.740595 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.741083 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.741685 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.742426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.742875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.743288 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.775677 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Going to try to terminate instance {{(pid=127416) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:54:57.862903 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-65b04631-eb1d-4a93-bff5-d2a11b9941ad tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 204 len: 0 microversion: 2.1 time: 0.134438 Aug 24 04:54:57.863603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 377/815] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:54:57 2022] DELETE /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:54:57.872851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:57.873477 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:57.880351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.880847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.881347 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.882486 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.883111 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.883792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.042811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:58.045236 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:58.052924 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f055a066-45e5-4715-b8dd-2ea428a3d60a tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.183938 Aug 24 04:54:58.055061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 439/816] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:57 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:59.077332 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:59.078120 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:59.084733 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.085211 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.085640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:59.086363 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.086811 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.087228 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:59.221813 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:59.231507 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c5ef78b2-8b2c-4821-898f-0d3705c90351 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.158034 Aug 24 04:54:59.231846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 378/817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:59 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:00.253080 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:00.253710 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:00.261689 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.262202 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.262639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.263350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.263805 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.264302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.406555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:00.415480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-99d6a778-cee5-4a02-bd1f-2aeafb4cab92 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1521 microversion: 2.1 time: 0.166591 Aug 24 04:55:00.416065 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 440/818] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:00 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:00.430325 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-412141473"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:00.431465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:00.438034 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.438665 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.439272 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.439978 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.440426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.440844 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.583540 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.network.security_group_api [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Removing security group b7a7e7ce-bd7c-4118-9b8a-949a044e0d6f from port cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7 Aug 24 04:55:00.894713 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-cdc0d3da-1dd6-4da3-983b-7cf905e1a52e req-02810bb5-31e7-48bd-9143-7f7b9df6c026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c55e66d8-d307-4552-af1b-dd59c2b6f94f", "name": "network-vif-deleted", "tag": "2cf3796f-8aa3-4a02-b84d-95b478e35e10"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:00.905875 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-cdc0d3da-1dd6-4da3-983b-7cf905e1a52e req-02810bb5-31e7-48bd-9143-7f7b9df6c026 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.906389 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-cdc0d3da-1dd6-4da3-983b-7cf905e1a52e req-02810bb5-31e7-48bd-9143-7f7b9df6c026 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.906830 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-cdc0d3da-1dd6-4da3-983b-7cf905e1a52e req-02810bb5-31e7-48bd-9143-7f7b9df6c026 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.920716 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-cdc0d3da-1dd6-4da3-983b-7cf905e1a52e req-02810bb5-31e7-48bd-9143-7f7b9df6c026 service nova] Creating event network-vif-deleted:2cf3796f-8aa3-4a02-b84d-95b478e35e10 for instance c55e66d8-d307-4552-af1b-dd59c2b6f94f on hv-cinder-85426 Aug 24 04:55:00.926217 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-cdc0d3da-1dd6-4da3-983b-7cf905e1a52e req-02810bb5-31e7-48bd-9143-7f7b9df6c026 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035298 Aug 24 04:55:00.929704 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 441/819] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:01.017680 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a666acf3-1bfc-40fc-9e5d-18d8fa5b2a41 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "POST /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/action" status: 202 len: 0 microversion: 2.1 time: 0.591888 Aug 24 04:55:01.018201 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 379/820] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 04:55:00 2022] POST /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:55:01.034468 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-361a1e41-5d41-4a96-8300-5eca45fe82da req-781d1716-4262-4a31-834a-87f0c7aa5506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02", "tag": "cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:01.057760 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-361a1e41-5d41-4a96-8300-5eca45fe82da req-781d1716-4262-4a31-834a-87f0c7aa5506 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.059690 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-361a1e41-5d41-4a96-8300-5eca45fe82da req-781d1716-4262-4a31-834a-87f0c7aa5506 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.064127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-361a1e41-5d41-4a96-8300-5eca45fe82da req-781d1716-4262-4a31-834a-87f0c7aa5506 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.092430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-361a1e41-5d41-4a96-8300-5eca45fe82da req-781d1716-4262-4a31-834a-87f0c7aa5506 service nova] Creating event network-changed:cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7 for instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 on hv-cinder-85426 Aug 24 04:55:01.106666 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-361a1e41-5d41-4a96-8300-5eca45fe82da req-781d1716-4262-4a31-834a-87f0c7aa5506 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075275 Aug 24 04:55:01.108196 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 442/821] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:01.437010 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:01.437791 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:01.444916 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.445751 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.446513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.447450 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.448090 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.448832 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.453550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:01.489992 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.491171 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.491890 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.492527 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lazy-loading 'fault' on Instance uuid c55e66d8-d307-4552-af1b-dd59c2b6f94f {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:01.565503 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5408f9ada24654839e479c7fe385ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1f238eb4f34d44ac93b85181ad7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:01.573354 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b61d49f9-2756-4470-b9b9-c9cf579d085f tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 200 len: 1311 microversion: 2.1 time: 0.140427 Aug 24 04:55:01.573938 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 380/822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:01 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:02.283752 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:02.284970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:02.292408 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.292904 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.293539 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.294302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.294784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.295179 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.393534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lazy-loading 'services' on Instance uuid 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:02.481160 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ce95b358-419d-4f42-8e4a-c35900e7a8ff tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "DELETE /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments/f60d8f12-01df-4eee-9e78-9cf837f6acd2" status: 202 len: 0 microversion: 2.1 time: 0.202080 Aug 24 04:55:02.481914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 443/823] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:55:02 2022] DELETE /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments/f60d8f12-01df-4eee-9e78-9cf837f6acd2 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:55:02.491081 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-38de5c3e-50e2-4096-b049-e8b518c15a14 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:02.494674 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-38de5c3e-50e2-4096-b049-e8b518c15a14 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:02.501763 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38de5c3e-50e2-4096-b049-e8b518c15a14 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.502418 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38de5c3e-50e2-4096-b049-e8b518c15a14 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.502925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38de5c3e-50e2-4096-b049-e8b518c15a14 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.504232 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38de5c3e-50e2-4096-b049-e8b518c15a14 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.505002 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38de5c3e-50e2-4096-b049-e8b518c15a14 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.505720 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38de5c3e-50e2-4096-b049-e8b518c15a14 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.545665 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-38de5c3e-50e2-4096-b049-e8b518c15a14 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059262 Aug 24 04:55:02.546672 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 381/824] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:02 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:02.596928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:02.597638 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] [instance: c55e66d8-d307-4552-af1b-dd59c2b6f94f] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:02.604552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.605040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.605480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.606224 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.606684 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.607105 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.621889 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] HTTP exception thrown: Instance c55e66d8-d307-4552-af1b-dd59c2b6f94f could not be found. Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Request method failure captured: Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f HTTP/1.1 Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa20IyEzD7U6F30SSskJS5-VXIlAQDQ0K19oWqsUTewrcIbAUWR7Aa4Zzl27820bwdwcAamNBDZvl1f_fj13FMS6YF8vnY0uVTe4hRADGrPARVoyHJZb11Pd6NwA_3kVyPjQEJcmGyj1ZzRHYY-6VD3wIiyVmXmgLBI9a6Fr0LxiYxo Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:55:02.623565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a1f238eb4f34d44ac93b85181ad7001"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1a1f238eb4f34d44ac93b85181ad7001"}]}] Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1a1f238eb4f34d44ac93b85181ad7001 Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766775083 Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 3d5408f9ada24654839e479c7fe385ce Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766775083-project Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance c55e66d8-d307-4552-af1b-dd59c2b6f94f could not be found. Aug 24 04:55:02.624926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': 'c55e66d8-d307-4552-af1b-dd59c2b6f94f'} Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c55e66d8-d307-4552-af1b-dd59c2b6f94f could not be found. Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:02.625727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c55e66d8-d307-4552-af1b-dd59c2b6f94f could not be found. Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c55e66d8-d307-4552-af1b-dd59c2b6f94f could not be found. Aug 24 04:55:02.627181 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:02.628479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] Returning 404 to user: Instance c55e66d8-d307-4552-af1b-dd59c2b6f94f could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:02.628479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7d5b31d9-cce1-490c-afcc-4acca52e7828 tempest-ServerRescueNegativeTestJSON-1766775083 tempest-ServerRescueNegativeTestJSON-1766775083-project] 10.222.0.60 "GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f" status: 404 len: 111 microversion: 2.1 time: 0.033116 Aug 24 04:55:02.629234 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 444/825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:02 2022] GET /compute/v2.1/servers/c55e66d8-d307-4552-af1b-dd59c2b6f94f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:03.227149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-13fa453b-f9b8-4f06-85ab-a33e1af32dd2 req-94a5b84f-6a12-42d9-b7ce-76e45a15f8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02", "tag": "cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:03.239552 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-13fa453b-f9b8-4f06-85ab-a33e1af32dd2 req-94a5b84f-6a12-42d9-b7ce-76e45a15f8f4 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.240193 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-13fa453b-f9b8-4f06-85ab-a33e1af32dd2 req-94a5b84f-6a12-42d9-b7ce-76e45a15f8f4 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.240978 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-13fa453b-f9b8-4f06-85ab-a33e1af32dd2 req-94a5b84f-6a12-42d9-b7ce-76e45a15f8f4 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.259359 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-13fa453b-f9b8-4f06-85ab-a33e1af32dd2 req-94a5b84f-6a12-42d9-b7ce-76e45a15f8f4 service nova] Creating event network-changed:cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7 for instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 on hv-cinder-85426 Aug 24 04:55:03.278950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-13fa453b-f9b8-4f06-85ab-a33e1af32dd2 req-94a5b84f-6a12-42d9-b7ce-76e45a15f8f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053936 Aug 24 04:55:03.289849 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 382/826] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:03.562659 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d0f85667-f159-4b37-87ce-c2139dac7386 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:03.564921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d0f85667-f159-4b37-87ce-c2139dac7386 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:03.571513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:03.574495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0f85667-f159-4b37-87ce-c2139dac7386 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.575767 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0f85667-f159-4b37-87ce-c2139dac7386 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.576371 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0f85667-f159-4b37-87ce-c2139dac7386 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.577257 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0f85667-f159-4b37-87ce-c2139dac7386 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.577875 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0f85667-f159-4b37-87ce-c2139dac7386 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.578998 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d0f85667-f159-4b37-87ce-c2139dac7386 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.630545 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d0f85667-f159-4b37-87ce-c2139dac7386 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074324 Aug 24 04:55:03.632736 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 445/827] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:03 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:55:03.650398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:03.652064 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:03.666155 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.668383 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.669497 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.671043 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.672056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.673859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.810443 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] HTTP exception thrown: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 is not attached to volume f60d8f12-01df-4eee-9e78-9cf837f6acd2 Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Request method failure captured: Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: DELETE /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments/f60d8f12-01df-4eee-9e78-9cf837f6acd2 HTTP/1.1 Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa5BByJ_FkPkHzZ8dt15VFOm3U3qvKLzdSx6QRLqw7LRnC7GXT1tqG85GG4i2f-rZUKQ_YSXMQ87GKoivHTpTH56xjTNNl8CaT1kigPqoCo38LHCGKSTBO7hV1cYM7Dx4Z8GwY2dA1Fvn6y_Pe5dVdadOU6SkF4Lt5zMKfGOuNIzK3Q Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 09a4b40ff55a4b4095912e0e58cbc374 Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-TestMinimumBasicScenario-1435473291 Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:55:03.813964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a4b40ff55a4b4095912e0e58cbc374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/09a4b40ff55a4b4095912e0e58cbc374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a4b40ff55a4b4095912e0e58cbc374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_09a4b40ff55a4b4095912e0e58cbc374"}]}] Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-TestMinimumBasicScenario-1435473291 Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 09a4b40ff55a4b4095912e0e58cbc374 Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1435473291 Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-TestMinimumBasicScenario-1435473291-project Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 14f695d39b654b7da7ee6d7aa0a8a7b3 Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-TestMinimumBasicScenario-1435473291-project Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:55:03.816804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 is not attached to volume f60d8f12-01df-4eee-9e78-9cf837f6acd2 Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'server_id': '82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02', 'id': 'f60d8f12-01df-4eee-9e78-9cf837f6acd2'} Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f60d8f12-01df-4eee-9e78-9cf837f6acd2. Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:03.819779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 is not attached to volume f60d8f12-01df-4eee-9e78-9cf837f6acd2 Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 is not attached to volume f60d8f12-01df-4eee-9e78-9cf837f6acd2 Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:03.823324 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Returning 404 to user: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 is not attached to volume f60d8f12-01df-4eee-9e78-9cf837f6acd2 {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:03.825806 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-95a96276-ac33-4171-97c8-f737268cb36b tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "DELETE /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments/f60d8f12-01df-4eee-9e78-9cf837f6acd2" status: 404 len: 154 microversion: 2.1 time: 0.175954 Aug 24 04:55:03.825806 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 383/828] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:55:03 2022] DELETE /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02/os-volume_attachments/f60d8f12-01df-4eee-9e78-9cf837f6acd2 => generated 154 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:05.033927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:05.034589 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:05.043087 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.043742 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.044699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.045530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.046154 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.046819 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.081475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:55:05.196391 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-01c726e9-d092-443a-a3d0-b439faf66064 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "DELETE /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 204 len: 0 microversion: 2.1 time: 0.166368 Aug 24 04:55:05.197676 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 446/829] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:55:05 2022] DELETE /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:55:05.209741 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:05.210570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:05.217865 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.219602 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.220125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.221868 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.224213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.224213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.460030 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:05.468126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-81bfafde-c046-4690-a4dc-4da1b45fa42f tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1553 microversion: 2.1 time: 0.264958 Aug 24 04:55:05.469269 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 384/830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:05 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:05.477337 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f768b875-76cb-427d-b59d-37c8b6b84a87 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:05.477912 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f768b875-76cb-427d-b59d-37c8b6b84a87 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:05.484333 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f768b875-76cb-427d-b59d-37c8b6b84a87 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.484800 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f768b875-76cb-427d-b59d-37c8b6b84a87 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.485231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f768b875-76cb-427d-b59d-37c8b6b84a87 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.486491 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f768b875-76cb-427d-b59d-37c8b6b84a87 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.488580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f768b875-76cb-427d-b59d-37c8b6b84a87 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.489021 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f768b875-76cb-427d-b59d-37c8b6b84a87 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.520285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f768b875-76cb-427d-b59d-37c8b6b84a87 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/ips" status: 200 len: 146 microversion: 2.1 time: 0.048949 Aug 24 04:55:05.520777 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 447/831] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:55:05 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:06.497162 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:06.498231 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:06.508161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.508654 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.509092 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.509805 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.510457 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.510897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.682108 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:06.691110 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8eafcefb-9da0-4140-b693-aa9f82b2fd01 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1553 microversion: 2.1 time: 0.197931 Aug 24 04:55:06.691702 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 385/832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:06 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:07.013680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-54a9a9eb-431c-44f1-b832-5dc43e00ad15 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bb5b31f-815f-4800-8451-2fc9b22ece8c"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:07.017623 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-54a9a9eb-431c-44f1-b832-5dc43e00ad15 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:07.025784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a9a9eb-431c-44f1-b832-5dc43e00ad15 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.026401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a9a9eb-431c-44f1-b832-5dc43e00ad15 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.026845 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a9a9eb-431c-44f1-b832-5dc43e00ad15 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.027570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a9a9eb-431c-44f1-b832-5dc43e00ad15 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.028056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a9a9eb-431c-44f1-b832-5dc43e00ad15 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.028592 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a9a9eb-431c-44f1-b832-5dc43e00ad15 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.217057 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-dd4d7b17-d3b9-49c1-a09b-250fdfdc1ca7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:07.218191 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-dd4d7b17-d3b9-49c1-a09b-250fdfdc1ca7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:07.229072 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dd4d7b17-d3b9-49c1-a09b-250fdfdc1ca7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.229662 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dd4d7b17-d3b9-49c1-a09b-250fdfdc1ca7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.230355 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dd4d7b17-d3b9-49c1-a09b-250fdfdc1ca7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.232646 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dd4d7b17-d3b9-49c1-a09b-250fdfdc1ca7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.233395 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dd4d7b17-d3b9-49c1-a09b-250fdfdc1ca7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.234088 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dd4d7b17-d3b9-49c1-a09b-250fdfdc1ca7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.262150 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-dd4d7b17-d3b9-49c1-a09b-250fdfdc1ca7 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/ips" status: 200 len: 151 microversion: 2.20 time: 0.054638 Aug 24 04:55:07.269505 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 386/833] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Aug 24 04:55:07 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:55:07.453186 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-54a9a9eb-431c-44f1-b832-5dc43e00ad15 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444690 Aug 24 04:55:07.460035 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 448/834] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:55:07 2022] POST /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:07.716307 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:07.717028 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:07.727525 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.728096 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.728554 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.729419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.730293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.731043 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.892489 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f695d39b654b7da7ee6d7aa0a8a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a4b40ff55a4b4095912e0e58cbc374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:07.902583 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9c233bac-31d0-4222-89f2-79d2872ecb30 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 200 len: 1553 microversion: 2.1 time: 0.190741 Aug 24 04:55:07.903553 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 387/835] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:07 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:08.074208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-9751ace3-737c-41af-bd6e-5e3e40422caa req-94a3aa28-bccf-445f-8713-8386ad526773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02", "name": "network-vif-deleted", "tag": "cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:08.086531 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-9751ace3-737c-41af-bd6e-5e3e40422caa req-94a3aa28-bccf-445f-8713-8386ad526773 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.087403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-9751ace3-737c-41af-bd6e-5e3e40422caa req-94a3aa28-bccf-445f-8713-8386ad526773 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.088119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-9751ace3-737c-41af-bd6e-5e3e40422caa req-94a3aa28-bccf-445f-8713-8386ad526773 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:08.102262 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-9751ace3-737c-41af-bd6e-5e3e40422caa req-94a3aa28-bccf-445f-8713-8386ad526773 service nova] Creating event network-vif-deleted:cf7e8421-1c67-4eec-a322-e0a1d9b1bcd7 for instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 on hv-cinder-85426 Aug 24 04:55:08.107491 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-9751ace3-737c-41af-bd6e-5e3e40422caa req-94a3aa28-bccf-445f-8713-8386ad526773 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039537 Aug 24 04:55:08.108508 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 449/836] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:08.237686 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-26f2b100-54dc-4cca-b68e-b7d64813a879 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Action: 'create', calling method: .version_select at 0x7fb05085b550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1748098998"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:08.611099 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-26f2b100-54dc-4cca-b68e-b7d64813a879 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.522078 Aug 24 04:55:08.621952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 388/837] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Aug 24 04:55:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 534 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 04:55:08.637483 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-efcfd619-ccb0-4417-ba8b-e4606f1fa80d tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb043fa8b80>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:08.707599 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-efcfd619-ccb0-4417-ba8b-e4606f1fa80d tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45" status: 200 len: 345 microversion: 2.1 time: 0.077096 Aug 24 04:55:08.708854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 450/838] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:55:08 2022] GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:08.926310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:08.926861 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] [instance: 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:08.934942 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.935450 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.935867 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:08.936581 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.937014 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.937429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:08.952683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] HTTP exception thrown: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 could not be found. Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Request method failure captured: Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 HTTP/1.1 Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa5BByJ_FkPkHzZ8dt15VFOm3U3qvKLzdSx6QRLqw7LRnC7GXT1tqG85GG4i2f-rZUKQ_YSXMQ87GKoivHTpTH56xjTNNl8CaT1kigPqoCo38LHCGKSTBO7hV1cYM7Dx4Z8GwY2dA1Fvn6y_Pe5dVdadOU6SkF4Lt5zMKfGOuNIzK3Q Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 09a4b40ff55a4b4095912e0e58cbc374 Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-TestMinimumBasicScenario-1435473291 Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:55:08.954292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a4b40ff55a4b4095912e0e58cbc374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/09a4b40ff55a4b4095912e0e58cbc374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a4b40ff55a4b4095912e0e58cbc374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_09a4b40ff55a4b4095912e0e58cbc374"}]}] Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-TestMinimumBasicScenario-1435473291 Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 09a4b40ff55a4b4095912e0e58cbc374 Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1435473291 Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-TestMinimumBasicScenario-1435473291-project Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 14f695d39b654b7da7ee6d7aa0a8a7b3 Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-TestMinimumBasicScenario-1435473291-project Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 could not be found. Aug 24 04:55:08.957371 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02'} Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 could not be found. Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:08.958221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 could not be found. Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 could not be found. Aug 24 04:55:08.959506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:08.961122 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Returning 404 to user: Instance 82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:08.961122 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7a912256-b166-43b2-9483-b7d02089c433 tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02" status: 404 len: 111 microversion: 2.1 time: 0.033789 Aug 24 04:55:08.961122 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 389/839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:08 2022] GET /compute/v2.1/servers/82ed0e75-fbc1-4d2d-a0ba-fae30cf61d02 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:08.965993 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ed486095-57d7-4660-a119-5212320250bf tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] Calling method '.version_select at 0x7fb043fcc430>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:08.991603 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ed486095-57d7-4660-a119-5212320250bf tempest-TestMinimumBasicScenario-1435473291 tempest-TestMinimumBasicScenario-1435473291-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-658819250" status: 202 len: 0 microversion: 2.1 time: 0.028964 Aug 24 04:55:08.992198 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 451/840] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Aug 24 04:55:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-658819250 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:55:09.280721 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:09.281297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:09.288835 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:09.289331 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:09.289771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.290517 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:09.290971 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:09.291404 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.317436 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lazy-loading 'flavor' on Instance uuid 25850e86-d01f-489f-b7be-a04e7854041b {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:09.569649 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0cf3a95b-d3c7-47fb-8552-e4c9fb944e00 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/action" status: 202 len: 0 microversion: 2.20 time: 0.292182 Aug 24 04:55:09.570395 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 390/841] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 24 04:55:09 2022] POST /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:55:09.579748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:09.579748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:09.590596 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:09.591911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:09.592976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.594549 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:09.595430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:09.596511 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.726668 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e372061a-f63c-4ec5-bc1d-33ec33e4d1ab tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb050973ca0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:09.779808 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:09.788693 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:09.790247 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:09.791433 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a7f92606-2d81-48e5-8808-4a7eabdb0320 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.216442 Aug 24 04:55:09.791972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 452/842] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:09 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:09.797594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e372061a-f63c-4ec5-bc1d-33ec33e4d1ab tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45" status: 200 len: 346 microversion: 2.1 time: 0.074791 Aug 24 04:55:09.803850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 391/843] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:55:09 2022] GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:09.824603 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9c7f21d1-31a5-47f2-948f-8439a1f3b67e tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Action: 'create', calling method: .version_select at 0x7fb043fa8670>, body: {"snapshot": {"volume_id": "5cafa134-cd71-4b1b-bafd-c06bad888f45", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-179450040"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:09.995718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9c7f21d1-31a5-47f2-948f-8439a1f3b67e tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.179658 Aug 24 04:55:09.996310 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 453/844] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Aug 24 04:55:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:10.008087 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ec057d7a-71c3-4516-bd50-e7cf10271af0 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb050885c10>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:10.044587 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ec057d7a-71c3-4516-bd50-e7cf10271af0 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32" status: 200 len: 286 microversion: 2.1 time: 0.040988 Aug 24 04:55:10.045343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 392/845] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 24 04:55:10 2022] GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:10.057747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b56f5b74-8a9f-403d-bf4c-f7e207b7ab88 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb043f75160>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:10.088343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b56f5b74-8a9f-403d-bf4c-f7e207b7ab88 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035541 Aug 24 04:55:10.088935 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 454/846] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Aug 24 04:55:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:10.100245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c032dd87-de97-4497-b761-80c593d12823 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb05090e430>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:10.137713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c032dd87-de97-4497-b761-80c593d12823 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32" status: 200 len: 286 microversion: 2.1 time: 0.041727 Aug 24 04:55:10.138351 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 393/847] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 24 04:55:10 2022] GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:10.817717 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:10.819754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:10.830715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.831666 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.832399 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.834825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.835720 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.836485 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.991345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:11.002288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:11.004047 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:11.006313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d2451be4-5bcc-4c2f-bc8b-38222c6ae962 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.194496 Aug 24 04:55:11.007003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 455/848] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:10 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:11.162125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-19c8fdda-84a1-4ce5-a81e-a0cdfd01c599 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb0508a1550>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:11.204507 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-19c8fdda-84a1-4ce5-a81e-a0cdfd01c599 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32" status: 200 len: 286 microversion: 2.1 time: 0.047127 Aug 24 04:55:11.205503 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 394/849] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 24 04:55:11 2022] GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:12.032478 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:12.033304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:12.041976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.042583 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.043220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.044002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.044530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.045275 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.220454 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-67f40f6d-a0f6-42c0-a0c8-ec25525f0316 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb050945040>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:12.241494 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:12.262688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:12.269026 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:12.270283 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-08e5c2c6-8a39-4954-9cf4-09d1c2ed6e4d tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.241697 Aug 24 04:55:12.271476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 456/850] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:12 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:12.281542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-67f40f6d-a0f6-42c0-a0c8-ec25525f0316 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32" status: 200 len: 286 microversion: 2.1 time: 0.065858 Aug 24 04:55:12.282737 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 395/851] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 24 04:55:12 2022] GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:13.296392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-58fcd386-12cf-411a-8a84-3e2316586dab tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb05004d700>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:13.314456 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:13.314456 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:13.315536 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:13.332178 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.335607 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.336753 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:13.338296 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.339300 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.340031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:13.360841 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-58fcd386-12cf-411a-8a84-3e2316586dab tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32" status: 200 len: 287 microversion: 2.1 time: 0.069793 Aug 24 04:55:13.361428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 457/852] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 24 04:55:13 2022] GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:13.378057 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b09782a6-7c7f-4afd-99e6-cf4239e98511 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb043fa8c10>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:13.476411 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b09782a6-7c7f-4afd-99e6-cf4239e98511 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32" status: 202 len: 0 microversion: 2.1 time: 0.106060 Aug 24 04:55:13.478984 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 458/853] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Aug 24 04:55:13 2022] DELETE /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:55:13.493430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6d65f858-05e3-4efd-a851-ae391e132bc2 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb043f21550>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:13.576000 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6d65f858-05e3-4efd-a851-ae391e132bc2 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32" status: 200 len: 286 microversion: 2.1 time: 0.088889 Aug 24 04:55:13.576936 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 459/854] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 24 04:55:13 2022] GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:13.677791 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:13.691149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:13.693390 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:13.695788 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a9561e78-7be2-4553-ac49-d800abac40e4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.390427 Aug 24 04:55:13.696458 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 396/855] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:13 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:14.589859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f3a9afb7-b57d-43d4-b2cc-f5cf054ab81b tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb043f57670>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:14.618663 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-f3a9afb7-b57d-43d4-b2cc-f5cf054ab81b tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] HTTP exception thrown: Snapshot 51749995-a832-4cc0-804f-8457ca483b32 could not be found. Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f3a9afb7-b57d-43d4-b2cc-f5cf054ab81b tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Request method failure captured: Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32 HTTP/1.1 Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa8sXiZTqHFO-Be4_RWI3sGrBUyHk-fK7gBtsLNHxKdGGZBDo5feL3pGO8nL_jGmaQzkooJLPG4Ejdh-p54zuZ70evWzfGfWEGknfQUB5lq5bPL4U3ihK4LOc92CmS29MR-eqRplSKNbI8dHvyn2LuRCKljJO6zEZdGL0ghH3-j1-Pk Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 4147ecfcf7fb4e6e81bc1e766507a8c3 Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:55:14.621369 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4147ecfcf7fb4e6e81bc1e766507a8c3"}]}] Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 4147ecfcf7fb4e6e81bc1e766507a8c3 Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesSnapshotsTestJSON-1597610338-project Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 03226b5c0f3c4701be2dc11816b7f4be Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1597610338-project Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Snapshot 51749995-a832-4cc0-804f-8457ca483b32 could not be found. Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '51749995-a832-4cc0-804f-8457ca483b32'} Aug 24 04:55:14.622871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 51749995-a832-4cc0-804f-8457ca483b32 could not be found. (HTTP 404) (Request-ID: req-f64819d8-46e5-4dd0-9907-49320acd481c) Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:14.623743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:55:14.628708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 51749995-a832-4cc0-804f-8457ca483b32 could not be found. Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 04:55:14.630184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 51749995-a832-4cc0-804f-8457ca483b32 could not be found. Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 51749995-a832-4cc0-804f-8457ca483b32 could not be found. Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f3a9afb7-b57d-43d4-b2cc-f5cf054ab81b tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Returning 404 to user: Snapshot 51749995-a832-4cc0-804f-8457ca483b32 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:14.632287 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f3a9afb7-b57d-43d4-b2cc-f5cf054ab81b tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32" status: 404 len: 111 microversion: 2.1 time: 0.038309 Aug 24 04:55:14.633302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 460/856] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 24 04:55:14 2022] GET /compute/v2.1/os-snapshots/51749995-a832-4cc0-804f-8457ca483b32 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:14.635463 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3fb9daa1-6e40-4a35-aefc-67725bb7d28f tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb050900550>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:14.724379 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:14.727845 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:14.735844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:14.736485 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:14.737059 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:14.737705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3fb9daa1-6e40-4a35-aefc-67725bb7d28f tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45" status: 202 len: 0 microversion: 2.1 time: 0.101305 Aug 24 04:55:14.738053 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:14.738624 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:14.739164 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:14.740905 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 397/857] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:55:14 2022] DELETE /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:55:14.751036 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0525bb4b-f3a8-419c-b868-afbe59bf551a tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb05095fee0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:14.868167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0525bb4b-f3a8-419c-b868-afbe59bf551a tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45" status: 200 len: 345 microversion: 2.1 time: 0.121992 Aug 24 04:55:14.868961 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 398/858] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:55:14 2022] GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:14.917849 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:14.927986 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:14.929930 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:14.931466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-37702cba-ec83-446b-927b-54c70fa422a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.214682 Aug 24 04:55:14.941648 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 461/859] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:14 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:15.110235 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-00273c0e-1535-4a07-ab3e-dd25eb6c47b2 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:15.112545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-00273c0e-1535-4a07-ab3e-dd25eb6c47b2 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:15.120267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-00273c0e-1535-4a07-ab3e-dd25eb6c47b2 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.120862 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-00273c0e-1535-4a07-ab3e-dd25eb6c47b2 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.121304 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-00273c0e-1535-4a07-ab3e-dd25eb6c47b2 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.122044 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-00273c0e-1535-4a07-ab3e-dd25eb6c47b2 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.122502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-00273c0e-1535-4a07-ab3e-dd25eb6c47b2 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.122929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-00273c0e-1535-4a07-ab3e-dd25eb6c47b2 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.163099 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-00273c0e-1535-4a07-ab3e-dd25eb6c47b2 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056861 Aug 24 04:55:15.164054 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 399/860] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:15 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:15.176299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7f3ff482-8a83-4a0d-b3bd-416de2784cdb tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:15.176902 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7f3ff482-8a83-4a0d-b3bd-416de2784cdb tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:15.184223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f3ff482-8a83-4a0d-b3bd-416de2784cdb tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.184894 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f3ff482-8a83-4a0d-b3bd-416de2784cdb tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.185428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f3ff482-8a83-4a0d-b3bd-416de2784cdb tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.186583 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f3ff482-8a83-4a0d-b3bd-416de2784cdb tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.187301 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f3ff482-8a83-4a0d-b3bd-416de2784cdb tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.187985 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7f3ff482-8a83-4a0d-b3bd-416de2784cdb tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.227334 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7f3ff482-8a83-4a0d-b3bd-416de2784cdb tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/9bb5b31f-815f-4800-8451-2fc9b22ece8c" status: 200 len: 194 microversion: 2.1 time: 0.055302 Aug 24 04:55:15.228337 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 462/861] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Aug 24 04:55:15 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/9bb5b31f-815f-4800-8451-2fc9b22ece8c => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:15.885626 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c611d71e-e7cb-42cc-9521-f784c927cb30 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb0509008b0>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:15.925759 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-c611d71e-e7cb-42cc-9521-f784c927cb30 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] HTTP exception thrown: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c611d71e-e7cb-42cc-9521-f784c927cb30 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Request method failure captured: Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 HTTP/1.1 Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa8sXiZTqHFO-Be4_RWI3sGrBUyHk-fK7gBtsLNHxKdGGZBDo5feL3pGO8nL_jGmaQzkooJLPG4Ejdh-p54zuZ70evWzfGfWEGknfQUB5lq5bPL4U3ihK4LOc92CmS29MR-eqRplSKNbI8dHvyn2LuRCKljJO6zEZdGL0ghH3-j1-Pk Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 4147ecfcf7fb4e6e81bc1e766507a8c3 Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:55:15.928264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4147ecfcf7fb4e6e81bc1e766507a8c3"}]}] Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 4147ecfcf7fb4e6e81bc1e766507a8c3 Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-VolumesSnapshotsTestJSON-1597610338-project Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 03226b5c0f3c4701be2dc11816b7f4be Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1597610338-project Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '5cafa134-cd71-4b1b-bafd-c06bad888f45'} Aug 24 04:55:15.929818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. (HTTP 404) (Request-ID: req-a4ba8d89-4b3a-4bb5-8626-b2f23a117c47) Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:15.930660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:55:15.931974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:55:15.933292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c611d71e-e7cb-42cc-9521-f784c927cb30 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Returning 404 to user: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c611d71e-e7cb-42cc-9521-f784c927cb30 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45" status: 404 len: 109 microversion: 2.1 time: 0.050756 Aug 24 04:55:15.935778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 400/862] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:55:15 2022] GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:15.949466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9bbfc7ba-8251-4359-9911-1bdafa7b6fe4 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb043fa8d30>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:15.960075 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:15.960486 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:15.968100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.968527 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.968969 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.969698 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.970249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.970686 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.986995 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-9bbfc7ba-8251-4359-9911-1bdafa7b6fe4 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] HTTP exception thrown: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9bbfc7ba-8251-4359-9911-1bdafa7b6fe4 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Request method failure captured: Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: DELETE /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 HTTP/1.1 Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa8sXiZTqHFO-Be4_RWI3sGrBUyHk-fK7gBtsLNHxKdGGZBDo5feL3pGO8nL_jGmaQzkooJLPG4Ejdh-p54zuZ70evWzfGfWEGknfQUB5lq5bPL4U3ihK4LOc92CmS29MR-eqRplSKNbI8dHvyn2LuRCKljJO6zEZdGL0ghH3-j1-Pk Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 4147ecfcf7fb4e6e81bc1e766507a8c3 Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:55:15.991244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4147ecfcf7fb4e6e81bc1e766507a8c3"}]}] Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 4147ecfcf7fb4e6e81bc1e766507a8c3 Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesSnapshotsTestJSON-1597610338-project Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 03226b5c0f3c4701be2dc11816b7f4be Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1597610338-project Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '5cafa134-cd71-4b1b-bafd-c06bad888f45'} Aug 24 04:55:15.992724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. (HTTP 404) (Request-ID: req-306a6e2b-185d-4d36-9a88-028411169f8b) Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:15.993611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:55:15.995859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 04:55:15.997259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9bbfc7ba-8251-4359-9911-1bdafa7b6fe4 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Returning 404 to user: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:15.998793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9bbfc7ba-8251-4359-9911-1bdafa7b6fe4 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45" status: 404 len: 109 microversion: 2.1 time: 0.050939 Aug 24 04:55:16.000529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 463/863] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:55:15 2022] DELETE /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:16.009464 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9eee8432-ab94-4649-a9b7-baf9d44d9969 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Calling method '.version_select at 0x7fb043f2e430>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:16.049290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-9eee8432-ab94-4649-a9b7-baf9d44d9969 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] HTTP exception thrown: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9eee8432-ab94-4649-a9b7-baf9d44d9969 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Request method failure captured: Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 HTTP/1.1 Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa8sXiZTqHFO-Be4_RWI3sGrBUyHk-fK7gBtsLNHxKdGGZBDo5feL3pGO8nL_jGmaQzkooJLPG4Ejdh-p54zuZ70evWzfGfWEGknfQUB5lq5bPL4U3ihK4LOc92CmS29MR-eqRplSKNbI8dHvyn2LuRCKljJO6zEZdGL0ghH3-j1-Pk Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 4147ecfcf7fb4e6e81bc1e766507a8c3 Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:55:16.051332 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4147ecfcf7fb4e6e81bc1e766507a8c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4147ecfcf7fb4e6e81bc1e766507a8c3"}]}] Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 4147ecfcf7fb4e6e81bc1e766507a8c3 Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1597610338 Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesSnapshotsTestJSON-1597610338-project Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 03226b5c0f3c4701be2dc11816b7f4be Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1597610338-project Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '5cafa134-cd71-4b1b-bafd-c06bad888f45'} Aug 24 04:55:16.054918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. (HTTP 404) (Request-ID: req-b47ff891-5fc8-4dde-96c7-987e2ebd90c7) Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:16.056312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:55:16.057976 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:55:16.059571 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9eee8432-ab94-4649-a9b7-baf9d44d9969 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] Returning 404 to user: Volume 5cafa134-cd71-4b1b-bafd-c06bad888f45 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9eee8432-ab94-4649-a9b7-baf9d44d9969 tempest-VolumesSnapshotsTestJSON-1597610338 tempest-VolumesSnapshotsTestJSON-1597610338-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45" status: 404 len: 109 microversion: 2.1 time: 0.051766 Aug 24 04:55:16.062556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 464/864] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 24 04:55:16 2022] GET /compute/v2.1/os-volumes/5cafa134-cd71-4b1b-bafd-c06bad888f45 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:16.451110 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:16.460918 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:16.462586 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:16.464052 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-dfbc1679-803a-437e-84bd-9e9755d3cf3f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.510649 Aug 24 04:55:16.464779 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 401/865] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:15 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:16.708275 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1adc32b2-9ea5-4bf3-b030-a4a5bc261fa9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e15d3d95-199b-4883-a46e-abc21befa26f"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:16.711783 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1adc32b2-9ea5-4bf3-b030-a4a5bc261fa9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:16.722425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1adc32b2-9ea5-4bf3-b030-a4a5bc261fa9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:16.722752 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1adc32b2-9ea5-4bf3-b030-a4a5bc261fa9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:16.723290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1adc32b2-9ea5-4bf3-b030-a4a5bc261fa9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:16.728813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1adc32b2-9ea5-4bf3-b030-a4a5bc261fa9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:16.730900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1adc32b2-9ea5-4bf3-b030-a4a5bc261fa9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:16.732318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1adc32b2-9ea5-4bf3-b030-a4a5bc261fa9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:16.928538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:17.257914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1adc32b2-9ea5-4bf3-b030-a4a5bc261fa9 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "POST /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547190 Aug 24 04:55:17.260678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 465/866] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:55:16 2022] POST /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:17.488972 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:17.489771 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:17.501043 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.501746 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.502377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.503335 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.503968 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.504624 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.700801 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:17.711472 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:17.712991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:17.714414 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-dbccd0b9-04b9-41f5-86d3-c7cd7530c931 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.229966 Aug 24 04:55:17.715335 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 402/867] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:17 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:17.861407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:17.862510 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:17.870387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.871149 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.871738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.872459 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.872911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.873360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.909030 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:55:18.007548 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0f174fa9-32e1-4452-993a-97b0a7a66405 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "DELETE /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 204 len: 0 microversion: 2.1 time: 0.153037 Aug 24 04:55:18.008588 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 466/868] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:55:17 2022] DELETE /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:55:18.021777 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:18.022588 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:18.030636 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:18.031847 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:18.032284 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:18.033311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:18.033847 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:18.034660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:18.199698 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:18.207873 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d185cf83-b6a1-4e2d-a4f6-cbdc22093df3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1576 microversion: 2.1 time: 0.195106 Aug 24 04:55:18.215417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 403/869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:18 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:18.762156 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:18.763322 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:18.775387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:18.776277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:18.777058 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:18.778323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:18.779285 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:18.780027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:18.969576 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:18.982932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:18.986163 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:18.988695 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-22fd364b-e85b-4470-9ede-e1b7269b712a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.236135 Aug 24 04:55:18.989303 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 467/870] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:18 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:19.230399 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:19.231044 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:19.238048 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:19.238510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:19.238948 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:19.240274 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:19.241056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:19.241878 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:19.405942 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:19.415757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-87f06acf-89ee-4bc8-bdd3-7e4a0b6802ee tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1576 microversion: 2.1 time: 0.189672 Aug 24 04:55:19.417294 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 404/871] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:19 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:20.016361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:20.017617 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:20.028570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:20.029207 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:20.029707 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:20.030681 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:20.031188 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:20.031733 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:20.184412 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:20.193822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:20.195749 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:20.197100 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-69de2de9-588b-4c27-9075-962338e7b76c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.187941 Aug 24 04:55:20.197668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 468/872] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:20 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:20.444850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:20.445429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:20.453243 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:20.453836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:20.454334 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:20.455080 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:20.455535 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:20.455965 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:20.461035 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:20.628791 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:20.637854 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1476fa8f-42dc-4332-a569-d696d7a9db0e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1576 microversion: 2.1 time: 0.196950 Aug 24 04:55:20.638709 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 405/873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:20 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:20.958534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-b9ed6f6c-3011-4962-b746-84a7e4e4b764 req-6267536d-9290-40b5-97f6-42d6744d598a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57311393-dc24-4693-a167-bafcb80a8c46", "name": "network-vif-deleted", "tag": "285aec92-b5fd-4f9f-bcd0-e92475d6d6bc"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:20.968418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-b9ed6f6c-3011-4962-b746-84a7e4e4b764 req-6267536d-9290-40b5-97f6-42d6744d598a service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:20.968959 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-b9ed6f6c-3011-4962-b746-84a7e4e4b764 req-6267536d-9290-40b5-97f6-42d6744d598a service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:20.969392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-b9ed6f6c-3011-4962-b746-84a7e4e4b764 req-6267536d-9290-40b5-97f6-42d6744d598a service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:20.982015 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-b9ed6f6c-3011-4962-b746-84a7e4e4b764 req-6267536d-9290-40b5-97f6-42d6744d598a service nova] Creating event network-vif-deleted:285aec92-b5fd-4f9f-bcd0-e92475d6d6bc for instance 57311393-dc24-4693-a167-bafcb80a8c46 on hv-cinder-85426 Aug 24 04:55:20.986992 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-b9ed6f6c-3011-4962-b746-84a7e4e4b764 req-6267536d-9290-40b5-97f6-42d6744d598a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031976 Aug 24 04:55:20.987865 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 469/874] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:21.221137 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:21.221766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:21.229739 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:21.230467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:21.230935 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:21.231934 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:21.232472 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:21.232865 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:21.405571 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:21.420825 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:21.422768 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:21.424155 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7ceb4c60-f461-49f9-a78b-3d5cda46ed4f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.206807 Aug 24 04:55:21.424529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 406/875] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:21 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:21.665448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:21.666607 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:21.673609 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:21.674362 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:21.675265 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:21.676080 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:21.676806 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:21.677754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:21.716864 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:21.717678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:21.718255 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:21.718838 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lazy-loading 'fault' on Instance uuid 57311393-dc24-4693-a167-bafcb80a8c46 {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:21.774338 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:21.782814 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a7f4e892-fc1c-43c1-a865-104680cd34e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 200 len: 1184 microversion: 2.1 time: 0.123779 Aug 24 04:55:21.790520 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 470/876] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:21 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 1184 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:22.448474 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:22.449116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:22.455898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:22.456378 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:22.456809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:22.457566 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:22.457988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:22.458510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:22.600316 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:22.609086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:22.610620 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:22.611789 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f5512d1e-66e9-4fe4-bd85-ca61235b710a tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.167289 Aug 24 04:55:22.612363 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 407/877] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:22 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:22.807844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:22.808502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:22.815026 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:22.815504 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:22.815950 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:22.816640 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:22.817087 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:22.817566 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:22.831676 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] HTTP exception thrown: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Request method failure captured: Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 HTTP/1.1 Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa5Agym_ab4WHdHqaA1mveq8VGe7F_JQrxNXkJSRB8DXEkhMk4Smb_fK9HTwbWATdh89iDdcVpWKHKWHx7lrnXVdtSfewoJV7n3L9tE5hrrHbPcZ18Qp_kmkZGotRzV7tl8w5hjYA68dQfMchBCDSIek-vs3XyfWhngD50CvKI1g-OE Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:55:22.833536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_003043b046cc4646a61fe4c27af47e67"}]}] Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-TestVolumeBootPattern-492767301 Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 105c18e25e104cb6a7b100caa2a96f04 Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:55:22.835290 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '57311393-dc24-4693-a167-bafcb80a8c46'} Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:22.836272 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:55:22.837851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:22.839270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Returning 404 to user: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:22.839270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7a70e7c1-b31b-451f-968a-ad67e6a4eba9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 404 len: 111 microversion: 2.1 time: 0.030969 Aug 24 04:55:22.839270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 471/878] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:22 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:22.943902 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-850529955", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1170355751", "security_groups": [{"name": "tempest-secgroup-smoke-1341339893"}], "block_device_mapping_v2": [{"uuid": "29814043-82ef-4d00-a595-a6f6ac39a090", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e2fdcab-491d-4305-ac60-290a289ebd7f"}]}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:23.092360 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] validate_networks() for [('2e2fdcab-491d-4305-ac60-290a289ebd7f', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:55:23.506170 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:55:23.506716 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:55:23.506928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:55:23.507283 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:55:23.507717 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:55:23.517367 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:23.517839 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:23.518370 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:23.519123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:23.519530 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:23.519954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:23.537717 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Getting quotas for project 003043b046cc4646a61fe4c27af47e67. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:55:23.546111 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Getting quotas for user 105c18e25e104cb6a7b100caa2a96f04 and project 003043b046cc4646a61fe4c27af47e67. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:55:23.603784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:55:23.605970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29814043-82ef-4d00-a595-a6f6ac39a090',volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:55:23.637837 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:23.638497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:23.646196 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:23.646689 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:23.647437 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:23.648237 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:23.648990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:23.649499 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:23.777841 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9fec7b17-943d-4649-8c15-708f517712a8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.837604 Aug 24 04:55:23.790267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 408/879] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:55:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 04:55:23.796116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-375b01ea-8733-4900-974c-6645293ac53f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:23.796116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-375b01ea-8733-4900-974c-6645293ac53f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:23.847766 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:23.861699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:23.863363 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:23.864668 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a80749c4-f2c8-4c3e-8ece-ee4c50b3ca59 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.230979 Aug 24 04:55:23.869337 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 472/880] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:23 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:55:23.878182 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-375b01ea-8733-4900-974c-6645293ac53f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:23.887687 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-375b01ea-8733-4900-974c-6645293ac53f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1094 microversion: 2.1 time: 0.100753 Aug 24 04:55:23.888056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 409/881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:23 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1094 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:24.899926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:24.901053 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:24.913234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:24.914887 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:24.916600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:24.918029 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:24.919719 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:24.934343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:24.934343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:24.934343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:24.934343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:24.934984 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:24.934984 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:24.936106 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:24.936934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:24.937703 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.027846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:25.036217 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ef04b867-bd90-46e1-9056-c651a75d0149 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1192 microversion: 2.1 time: 0.128199 Aug 24 04:55:25.037334 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 410/882] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:24 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1192 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:25.042453 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1067c986-c357-447a-bcb0-f4db17f45978 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:25.045053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1067c986-c357-447a-bcb0-f4db17f45978 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:25.056365 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1067c986-c357-447a-bcb0-f4db17f45978 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.057395 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1067c986-c357-447a-bcb0-f4db17f45978 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.058084 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1067c986-c357-447a-bcb0-f4db17f45978 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.058907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1067c986-c357-447a-bcb0-f4db17f45978 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.059421 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1067c986-c357-447a-bcb0-f4db17f45978 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.059830 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1067c986-c357-447a-bcb0-f4db17f45978 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.108211 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1067c986-c357-447a-bcb0-f4db17f45978 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.069515 Aug 24 04:55:25.108814 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 411/883] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:25 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:25.164550 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:25.176777 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:25.179711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:25.182106 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-00eea977-8827-46ae-955e-e6dcbbd163a9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.289721 Aug 24 04:55:25.182686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 473/884] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:24 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:25.265137 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ab0264f2-1f53-45be-bba9-b9af4e3af230 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:25.265891 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ab0264f2-1f53-45be-bba9-b9af4e3af230 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:25.274590 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ab0264f2-1f53-45be-bba9-b9af4e3af230 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.275086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ab0264f2-1f53-45be-bba9-b9af4e3af230 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.275523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ab0264f2-1f53-45be-bba9-b9af4e3af230 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.276317 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ab0264f2-1f53-45be-bba9-b9af4e3af230 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.276786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ab0264f2-1f53-45be-bba9-b9af4e3af230 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.277213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ab0264f2-1f53-45be-bba9-b9af4e3af230 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.326493 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ab0264f2-1f53-45be-bba9-b9af4e3af230 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/9bb5b31f-815f-4800-8451-2fc9b22ece8c" status: 200 len: 194 microversion: 2.1 time: 0.065249 Aug 24 04:55:25.329193 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 412/885] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Aug 24 04:55:25 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/9bb5b31f-815f-4800-8451-2fc9b22ece8c => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:25.338938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:25.339427 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:25.345515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.346010 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.346462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.347145 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.347594 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.348008 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.438246 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lazy-loading 'services' on Instance uuid a820ec55-b7ec-42ee-926e-259580e5df2b {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:25.517774 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f95d91b0-7a88-4d0f-9cd9-2d44cfc5d3c4 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/9bb5b31f-815f-4800-8451-2fc9b22ece8c" status: 202 len: 0 microversion: 2.1 time: 0.182902 Aug 24 04:55:25.518468 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 474/886] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:55:25 2022] DELETE /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/9bb5b31f-815f-4800-8451-2fc9b22ece8c => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:55:26.060255 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:26.061939 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:26.070357 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:26.070863 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:26.071302 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:26.072399 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:26.072858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:26.073387 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:26.207721 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:26.208593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:26.215739 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:26.216567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:26.217164 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:26.217987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:26.218554 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:26.219087 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:26.227538 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:26.235686 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2b937ef7-42e8-4f88-bc20-09b818e80616 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1278 microversion: 2.1 time: 0.179644 Aug 24 04:55:26.238224 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 413/887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:26 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:26.376002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:26.385718 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:26.387791 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:26.389294 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-dbd41a74-421a-4e48-a400-aded22854947 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1744 microversion: 2.20 time: 0.186445 Aug 24 04:55:26.389948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 475/888] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:26 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:26.750921 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-b612739e-0853-490d-9a64-3988deff8b34 req-6e34e02a-9843-41d7-968c-c05ae5c02bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa50707e-0efd-4a9e-be1c-b2abfc2b1160", "tag": "7a40828b-ec56-4289-bf85-8dd64624ce3f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:26.767178 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-b612739e-0853-490d-9a64-3988deff8b34 req-6e34e02a-9843-41d7-968c-c05ae5c02bc8 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:26.769318 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-b612739e-0853-490d-9a64-3988deff8b34 req-6e34e02a-9843-41d7-968c-c05ae5c02bc8 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:26.769853 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-b612739e-0853-490d-9a64-3988deff8b34 req-6e34e02a-9843-41d7-968c-c05ae5c02bc8 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:26.788424 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-b612739e-0853-490d-9a64-3988deff8b34 req-6e34e02a-9843-41d7-968c-c05ae5c02bc8 service nova] Creating event network-changed:7a40828b-ec56-4289-bf85-8dd64624ce3f for instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 on hv-cinder-85426 Aug 24 04:55:26.795562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-b612739e-0853-490d-9a64-3988deff8b34 req-6e34e02a-9843-41d7-968c-c05ae5c02bc8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052099 Aug 24 04:55:26.796758 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 414/889] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:27.258439 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:27.259053 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:27.266279 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.266639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.267079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.267785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.268253 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.268681 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.409839 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:27.414267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:27.414957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:27.419765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3c9ce46f-e1be-49a0-80df-11d0f3a75e5c tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.165359 Aug 24 04:55:27.420456 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 476/890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:27 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:27.428245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.428245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.428245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.428245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.428679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.428679 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.565769 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:27.581304 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:27.585208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:27.586460 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3c82b33a-78d7-4a5c-bb38-ae480d62a724 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1744 microversion: 2.20 time: 0.176907 Aug 24 04:55:27.587034 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 415/891] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:27 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:55:27.746739 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4003e335-805b-4c6d-932f-d556754aac79 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:27.748424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4003e335-805b-4c6d-932f-d556754aac79 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:27.759192 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4003e335-805b-4c6d-932f-d556754aac79 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.759888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4003e335-805b-4c6d-932f-d556754aac79 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.760671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4003e335-805b-4c6d-932f-d556754aac79 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.761933 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4003e335-805b-4c6d-932f-d556754aac79 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.762657 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4003e335-805b-4c6d-932f-d556754aac79 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.763378 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4003e335-805b-4c6d-932f-d556754aac79 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.803580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4003e335-805b-4c6d-932f-d556754aac79 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/e15d3d95-199b-4883-a46e-abc21befa26f" status: 200 len: 194 microversion: 2.1 time: 0.064723 Aug 24 04:55:27.806246 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 477/892] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Aug 24 04:55:27 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/e15d3d95-199b-4883-a46e-abc21befa26f => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:27.815193 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:27.816122 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:27.823410 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.823906 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.824534 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.825249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.825708 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.826168 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.932047 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lazy-loading 'services' on Instance uuid a820ec55-b7ec-42ee-926e-259580e5df2b {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:28.035398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ce9ddadb-1c6c-4377-8041-300ef68d698e tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/e15d3d95-199b-4883-a46e-abc21befa26f" status: 202 len: 0 microversion: 2.1 time: 0.224233 Aug 24 04:55:28.039216 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 416/893] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:55:27 2022] DELETE /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments/e15d3d95-199b-4883-a46e-abc21befa26f => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:55:28.442392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:28.443777 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:28.450313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.451121 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.451761 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.452644 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.453118 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.453544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.613733 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:28.614576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:28.622376 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.623138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.623810 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.625050 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.625912 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.627145 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.629629 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:28.641223 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4eb9f016-ccb4-435a-a7fa-c9bd8c439a49 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.202234 Aug 24 04:55:28.643835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 478/894] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:28 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:28.821991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:28.839482 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:28.841878 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:28.843233 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8f5e27f8-090a-43c0-a34c-a0b627d05667 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.235344 Aug 24 04:55:28.844276 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 417/895] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:28 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:29.261591 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e2b93f5d-9c23-490b-b6c3-46acefe84dce tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:29.263962 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e2b93f5d-9c23-490b-b6c3-46acefe84dce tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:29.272525 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2b93f5d-9c23-490b-b6c3-46acefe84dce tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.273288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2b93f5d-9c23-490b-b6c3-46acefe84dce tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.273917 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2b93f5d-9c23-490b-b6c3-46acefe84dce tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.275391 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2b93f5d-9c23-490b-b6c3-46acefe84dce tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.276027 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2b93f5d-9c23-490b-b6c3-46acefe84dce tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.276456 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2b93f5d-9c23-490b-b6c3-46acefe84dce tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.314871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:29.324857 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e2b93f5d-9c23-490b-b6c3-46acefe84dce tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067844 Aug 24 04:55:29.326400 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 479/896] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:29 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:55:29.336987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-ff50e8b1-9942-40e2-b95d-0363da323ad5 req-10767e13-c1bf-4776-804e-64148ae5a227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25850e86-d01f-489f-b7be-a04e7854041b", "name": "network-vif-plugged", "status": "completed", "tag": "c95760a7-3a19-4223-bc23-f813a2768a06"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:29.353499 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-ff50e8b1-9942-40e2-b95d-0363da323ad5 req-10767e13-c1bf-4776-804e-64148ae5a227 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.354397 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-ff50e8b1-9942-40e2-b95d-0363da323ad5 req-10767e13-c1bf-4776-804e-64148ae5a227 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.355064 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-ff50e8b1-9942-40e2-b95d-0363da323ad5 req-10767e13-c1bf-4776-804e-64148ae5a227 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.373775 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-ff50e8b1-9942-40e2-b95d-0363da323ad5 req-10767e13-c1bf-4776-804e-64148ae5a227 service nova] Creating event network-vif-plugged:c95760a7-3a19-4223-bc23-f813a2768a06 for instance 25850e86-d01f-489f-b7be-a04e7854041b on hv-cinder-85426 Aug 24 04:55:29.379578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-ff50e8b1-9942-40e2-b95d-0363da323ad5 req-10767e13-c1bf-4776-804e-64148ae5a227 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046394 Aug 24 04:55:29.381826 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 418/897] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:29.525075 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ef70d00e-07e5-4ceb-8937-0bb332a5c703 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:29.529929 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ef70d00e-07e5-4ceb-8937-0bb332a5c703 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:29.546602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef70d00e-07e5-4ceb-8937-0bb332a5c703 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.547085 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef70d00e-07e5-4ceb-8937-0bb332a5c703 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.547926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef70d00e-07e5-4ceb-8937-0bb332a5c703 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.548582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef70d00e-07e5-4ceb-8937-0bb332a5c703 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.549038 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef70d00e-07e5-4ceb-8937-0bb332a5c703 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.549458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ef70d00e-07e5-4ceb-8937-0bb332a5c703 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.599890 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ef70d00e-07e5-4ceb-8937-0bb332a5c703 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079889 Aug 24 04:55:29.606696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 480/898] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:29 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:55:29.666837 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:29.668538 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:29.676043 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.691929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.695557 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.696723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.697350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.702257 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:29.702888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:29.716184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.717108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.717741 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.718893 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.720802 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.722510 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.765988 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:55:29.882110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d1695a52-c013-44ed-a497-1a721ecc0898 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 204 len: 0 microversion: 2.1 time: 0.181775 Aug 24 04:55:29.884691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 481/899] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:55:29 2022] DELETE /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:55:29.900396 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:29.903941 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:29.923733 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.924465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.925199 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.927841 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.929414 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.934288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.977706 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:29.993402 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5ed3e013-c7b0-41f7-8fc9-477c642b6217 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.331646 Aug 24 04:55:29.996687 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 419/900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:29 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:30.012007 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:30.014107 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:30.030059 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:30.030059 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:30.030059 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:30.030059 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:30.030895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:30.030895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:30.194260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:30.210803 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:30.212367 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:30.213598 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3a73a9fe-4155-4350-a475-9986ad7245df tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.327326 Aug 24 04:55:30.220557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 482/901] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:29 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:30.224939 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:30.233434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7a7bea48-1a8f-4869-b133-5d5000cda5f8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1674 microversion: 2.1 time: 0.235694 Aug 24 04:55:30.242687 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 420/902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:29 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:31.017663 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:31.019316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:31.028492 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.030283 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.030928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.034547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.035807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.036807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.247504 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:31.248167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:31.251532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:31.256341 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.257068 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.257970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.259210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.259742 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.260147 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3c535374-a738-4926-9efb-07b7835f0d13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.246922 Aug 24 04:55:31.260288 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.274361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 483/903] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:31 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:31.274361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:31.274361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:31.274891 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.275280 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.275898 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.276792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.277528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.278228 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.497302 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:31.504859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:31.510767 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:31.512582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:31.514566 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-37b96724-d95a-46d4-b7a5-837ccaf93b75 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1674 microversion: 2.1 time: 0.251324 Aug 24 04:55:31.514847 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d83e6e55-eefa-48be-b13a-37248876332f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.271538 Aug 24 04:55:31.515672 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 421/904] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:31 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:31.516139 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 484/905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:31 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:32.286103 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:32.287376 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:32.294704 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:32.295482 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:32.296175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:32.297135 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:32.297814 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:32.298492 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:32.486065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:32.496461 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8fc6fdf0-638e-4438-8caf-f75cdb267efa tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.216617 Aug 24 04:55:32.497319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 422/906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:32 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:32.538041 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:32.538831 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:32.542816 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:32.547309 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:32.553744 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:32.554301 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:32.554745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:32.560511 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:32.561018 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:32.561512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:32.564688 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:32.565578 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:32.566153 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:32.567151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:32.567934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:32.568597 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:32.691216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:32.700686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-114bd79e-4e2c-4901-beb3-f40d6dd954bd tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1606 microversion: 2.1 time: 0.167777 Aug 24 04:55:32.701277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 485/907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:32 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1606 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:32.791124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:32.801143 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:32.803881 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:32.805183 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c64dcf21-8122-4f73-8ec2-86e976fe793b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.269624 Aug 24 04:55:32.806116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 423/908] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:32 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:55:33.065533 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-137e511b-36c7-47e9-ab63-13c87291926a req-7caebfa9-b219-4294-96b6-5cdcfd0fb273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a820ec55-b7ec-42ee-926e-259580e5df2b", "name": "network-vif-deleted", "tag": "a0efb7f9-c264-4d80-88ee-44bc06fec7d8"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:33.078580 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-137e511b-36c7-47e9-ab63-13c87291926a req-7caebfa9-b219-4294-96b6-5cdcfd0fb273 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.079079 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-137e511b-36c7-47e9-ab63-13c87291926a req-7caebfa9-b219-4294-96b6-5cdcfd0fb273 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.079527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-137e511b-36c7-47e9-ab63-13c87291926a req-7caebfa9-b219-4294-96b6-5cdcfd0fb273 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.094357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-137e511b-36c7-47e9-ab63-13c87291926a req-7caebfa9-b219-4294-96b6-5cdcfd0fb273 service nova] Creating event network-vif-deleted:a0efb7f9-c264-4d80-88ee-44bc06fec7d8 for instance a820ec55-b7ec-42ee-926e-259580e5df2b on hv-cinder-85426 Aug 24 04:55:33.100791 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-137e511b-36c7-47e9-ab63-13c87291926a req-7caebfa9-b219-4294-96b6-5cdcfd0fb273 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039195 Aug 24 04:55:33.105482 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 486/909] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:33.519975 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:33.520843 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:33.534727 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:33.536805 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.550141 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.554759 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.555691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.556262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.557223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.565307 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:33.725583 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:33.727177 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:33.741903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:33.745349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.746324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.747036 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.748731 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.749370 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.750926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.803774 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:33.808402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.809151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.809735 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.810503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lazy-loading 'fault' on Instance uuid a820ec55-b7ec-42ee-926e-259580e5df2b {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:33.813942 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-7027ed46-d2c6-47af-b8b3-1fc534f2c81f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.300449 Aug 24 04:55:33.826391 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 424/910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:33 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:33.845663 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:33.850149 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:33.867631 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.876876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.878938 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.880580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.883248 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.883962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.884634 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=8 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:33.918327 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ad8df34f8e405792afe94b91382122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d97457b5cc4100a1ca1685f4c371e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:33.933096 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-be74df34-e32b-47ac-90e5-19cfa7acb784 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 200 len: 1327 microversion: 2.1 time: 0.214562 Aug 24 04:55:33.950433 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 487/911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:33 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 1327 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:34.151867 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:34.163951 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:34.165089 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:34.167247 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-67d33639-2f31-4c69-a7fb-6f83a89dea8f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.341011 Aug 24 04:55:34.183417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 425/912] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:33 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:34.843971 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:34.845288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:34.856152 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:34.856655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:34.857577 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:34.857805 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:34.858302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:34.858791 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:34.959271 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:34.959993 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:34.967154 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:34.968035 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:34.968035 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:34.968827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:34.969252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:34.969713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:34.985217 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] HTTP exception thrown: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Request method failure captured: Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b HTTP/1.1 Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3DKU-H0f0UOvfBTpwdCRJuw4LGb8x5sm3i_Spm38K1R181ak2vWLi3qJl1d1n0lmPD_o7-KMQb4vcjVFQ-i77c9Srn7Msbs9A83DrnT9AdubKeVAnpwhaXTxnBef8m_nqIIUm7pLiVrrg0IevV-v0KH5agHhxIncSel0Pb5RTACR4 Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:55:34.986899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2d97457b5cc4100a1ca1685f4c371e5"}]}] Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 42ad8df34f8e405792afe94b91382122 Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:34.988374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': 'a820ec55-b7ec-42ee-926e-259580e5df2b'} Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:34.989147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:34.991384 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:34.992957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Returning 404 to user: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:34.992957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9d79cb99-9bb8-4ea0-a8ef-89a969b06573 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 404 len: 111 microversion: 2.1 time: 0.033614 Aug 24 04:55:34.993269 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 426/913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:34 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:34.998130 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b1325ab0-7d43-4988-81dd-1b95126a723c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '.version_select at 0x7fb0507e5160>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:35.022126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b1325ab0-7d43-4988-81dd-1b95126a723c tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-463056679" status: 202 len: 0 microversion: 2.1 time: 0.026853 Aug 24 04:55:35.022710 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 427/914] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 24 04:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-463056679 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:55:35.053962 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:35.073944 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6ca85391-43cf-4b69-8336-96a6dc8db75a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.233770 Aug 24 04:55:35.074587 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 488/915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:34 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:35.194933 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:35.195600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:35.222546 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:35.223049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:35.223490 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:35.224500 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:35.225107 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:35.225542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:35.454144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:35.465312 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:35.467561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:35.469030 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e046b5c8-ec7c-4c26-bfcd-67c2a6147b1c tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.280144 Aug 24 04:55:35.471795 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 428/916] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:35 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:36.100729 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:36.102132 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:36.115816 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:36.116440 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:36.117118 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:36.118072 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:36.118924 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:36.119706 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:36.349021 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:36.360335 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-dbc3a14a-c0c9-43fd-ba68-27a3d72b352f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.264380 Aug 24 04:55:36.361121 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 489/917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:36 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:36.494844 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:36.496688 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:36.503866 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:36.504871 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:36.506629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:36.507609 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:36.508356 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:36.508957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:36.706872 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:36.735621 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:36.739121 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:36.741336 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f14d9d63-2458-4ba4-bc78-b2ab4a21c45e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.252002 Aug 24 04:55:36.757694 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 429/918] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:36 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:37.387398 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:37.388903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:37.409312 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-73df1132-0ce2-4300-a93e-ab1b0df4bcf1 req-dee68d6f-e64b-4908-9f40-7727427e0067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa50707e-0efd-4a9e-be1c-b2abfc2b1160", "name": "network-vif-plugged", "status": "completed", "tag": "7a40828b-ec56-4289-bf85-8dd64624ce3f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:37.410886 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:37.413106 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:37.414133 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:37.417040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:37.418102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:37.418994 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:37.454723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-73df1132-0ce2-4300-a93e-ab1b0df4bcf1 req-dee68d6f-e64b-4908-9f40-7727427e0067 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:37.455313 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-73df1132-0ce2-4300-a93e-ab1b0df4bcf1 req-dee68d6f-e64b-4908-9f40-7727427e0067 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:37.461387 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-73df1132-0ce2-4300-a93e-ab1b0df4bcf1 req-dee68d6f-e64b-4908-9f40-7727427e0067 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:37.498955 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-73df1132-0ce2-4300-a93e-ab1b0df4bcf1 req-dee68d6f-e64b-4908-9f40-7727427e0067 service nova] Creating event network-vif-plugged:7a40828b-ec56-4289-bf85-8dd64624ce3f for instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 on hv-cinder-85426 Aug 24 04:55:37.510475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-73df1132-0ce2-4300-a93e-ab1b0df4bcf1 req-dee68d6f-e64b-4908-9f40-7727427e0067 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110687 Aug 24 04:55:37.513736 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 430/919] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:37.729608 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:37.738986 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-cbd5bd7d-938a-4d96-9a9f-4d0be80194d5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.356510 Aug 24 04:55:37.754421 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 490/920] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:37 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:37.766836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:37.767828 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:37.783043 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:37.783863 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:37.784548 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:37.785472 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:37.786167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:37.787742 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:37.954711 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:37.967221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:37.969463 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:37.971586 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-bb457a44-f65d-4233-8be8-17e894c1dd0b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.209731 Aug 24 04:55:37.989892 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 431/921] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:37 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:38.574889 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:38.575445 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:38.582323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:38.582823 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:38.583260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:38.584701 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:38.585166 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:38.585593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:38.604151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] HTTP exception thrown: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Request method failure captured: Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: DELETE /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b HTTP/1.1 Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3DKU-H0f0UOvfBTpwdCRJuw4LGb8x5sm3i_Spm38K1R181ak2vWLi3qJl1d1n0lmPD_o7-KMQb4vcjVFQ-i77c9Srn7Msbs9A83DrnT9AdubKeVAnpwhaXTxnBef8m_nqIIUm7pLiVrrg0IevV-v0KH5agHhxIncSel0Pb5RTACR4 Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:55:38.605877 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2d97457b5cc4100a1ca1685f4c371e5"}]}] Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 42ad8df34f8e405792afe94b91382122 Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.607270 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': 'a820ec55-b7ec-42ee-926e-259580e5df2b'} Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:38.608004 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.609278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.611037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Returning 404 to user: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:38.611037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-4c4a1909-508c-41f9-8943-9fb6c17a99ec tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 404 len: 111 microversion: 2.1 time: 0.037153 Aug 24 04:55:38.611037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 491/922] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:55:38 2022] DELETE /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:38.617298 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:38.617926 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: a820ec55-b7ec-42ee-926e-259580e5df2b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:38.626401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:38.626946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:38.627655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:38.628655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:38.629359 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:38.629801 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:38.652333 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] HTTP exception thrown: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Request method failure captured: Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b HTTP/1.1 Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3DKU-H0f0UOvfBTpwdCRJuw4LGb8x5sm3i_Spm38K1R181ak2vWLi3qJl1d1n0lmPD_o7-KMQb4vcjVFQ-i77c9Srn7Msbs9A83DrnT9AdubKeVAnpwhaXTxnBef8m_nqIIUm7pLiVrrg0IevV-v0KH5agHhxIncSel0Pb5RTACR4 Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:55:38.654529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2d97457b5cc4100a1ca1685f4c371e5"}]}] Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 42ad8df34f8e405792afe94b91382122 Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.659419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': 'a820ec55-b7ec-42ee-926e-259580e5df2b'} Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:38.660262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. Aug 24 04:55:38.662126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:55:38.664274 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Returning 404 to user: Instance a820ec55-b7ec-42ee-926e-259580e5df2b could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:38.664274 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-620d3f7f-5757-4d0d-936c-365cdc7aabc8 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b" status: 404 len: 111 microversion: 2.1 time: 0.042825 Aug 24 04:55:38.664274 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 432/923] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:38 2022] GET /compute/v2.1/servers/a820ec55-b7ec-42ee-926e-259580e5df2b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:38.767084 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:38.767605 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:38.778450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:38.779988 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:38.780896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:38.785207 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:38.791835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:38.792020 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:38.975889 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:38.984572 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ddf50116-7f45-4e44-8804-152894d7307a tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1266 microversion: 2.1 time: 0.223997 Aug 24 04:55:38.998375 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:38.998894 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 492/924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:38 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:38.999752 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:39.009104 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:39.009837 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:39.010500 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:39.011485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:39.012445 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:39.013569 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:39.216773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:39.229252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:39.230816 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:39.232306 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-afbba8c8-d4e2-4f17-b8a9-b2bd358c1100 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.238486 Aug 24 04:55:39.233447 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 433/925] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:38 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:39.718593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-dc1fb0e7-366c-45fc-8ad9-4dadd8e4e071 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:39.719798 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-dc1fb0e7-366c-45fc-8ad9-4dadd8e4e071 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:39.726770 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc1fb0e7-366c-45fc-8ad9-4dadd8e4e071 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:39.727251 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc1fb0e7-366c-45fc-8ad9-4dadd8e4e071 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:39.727879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc1fb0e7-366c-45fc-8ad9-4dadd8e4e071 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:39.728581 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc1fb0e7-366c-45fc-8ad9-4dadd8e4e071 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:39.729032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc1fb0e7-366c-45fc-8ad9-4dadd8e4e071 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:39.729450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dc1fb0e7-366c-45fc-8ad9-4dadd8e4e071 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:39.760574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-dc1fb0e7-366c-45fc-8ad9-4dadd8e4e071 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/ips" status: 200 len: 150 microversion: 2.1 time: 0.046243 Aug 24 04:55:39.767652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 493/926] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 24 04:55:39 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:40.008204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:40.008204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:40.026160 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.026160 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.026160 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.026160 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.026601 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.026601 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.060526 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:40.062187 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:40.074759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.076509 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.077101 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.077638 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.078120 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.078549 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] HTTP exception thrown: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Request method failure captured: Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: DELETE /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d HTTP/1.1 Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3DKU-H0f0UOvfBTpwdCRJuw4LGb8x5sm3i_Spm38K1R181ak2vWLi3qJl1d1n0lmPD_o7-KMQb4vcjVFQ-i77c9Srn7Msbs9A83DrnT9AdubKeVAnpwhaXTxnBef8m_nqIIUm7pLiVrrg0IevV-v0KH5agHhxIncSel0Pb5RTACR4 Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:55:40.111964 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2d97457b5cc4100a1ca1685f4c371e5"}]}] Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 42ad8df34f8e405792afe94b91382122 Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.113747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '02869b36-2e27-488f-9e94-c82e7094038d'} Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:40.115216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.116678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.118159 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Returning 404 to user: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:40.118159 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-bc8e9752-f6fc-49b3-b822-87d56dccc760 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "DELETE /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 404 len: 111 microversion: 2.1 time: 0.059140 Aug 24 04:55:40.119439 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 494/927] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:55:40 2022] DELETE /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:40.124249 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:40.124956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] [instance: 02869b36-2e27-488f-9e94-c82e7094038d] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:40.132231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.132818 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.133326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.134170 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.134689 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.135173 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.151197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] HTTP exception thrown: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Request method failure captured: Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d HTTP/1.1 Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3DKU-H0f0UOvfBTpwdCRJuw4LGb8x5sm3i_Spm38K1R181ak2vWLi3qJl1d1n0lmPD_o7-KMQb4vcjVFQ-i77c9Srn7Msbs9A83DrnT9AdubKeVAnpwhaXTxnBef8m_nqIIUm7pLiVrrg0IevV-v0KH5agHhxIncSel0Pb5RTACR4 Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:55:40.152724 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2d97457b5cc4100a1ca1685f4c371e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2d97457b5cc4100a1ca1685f4c371e5"}]}] Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: d2d97457b5cc4100a1ca1685f4c371e5 Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1514539409 Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 42ad8df34f8e405792afe94b91382122 Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeTestJSON-1514539409-project Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.154402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '02869b36-2e27-488f-9e94-c82e7094038d'} Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:40.155656 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. Aug 24 04:55:40.158428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:55:40.160619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] Returning 404 to user: Instance 02869b36-2e27-488f-9e94-c82e7094038d could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:40.160619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7199596e-7bbf-4a1a-b633-6d4f5cc257c1 tempest-AttachVolumeTestJSON-1514539409 tempest-AttachVolumeTestJSON-1514539409-project] 10.222.0.60 "GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d" status: 404 len: 111 microversion: 2.1 time: 0.033845 Aug 24 04:55:40.160619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 495/928] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:40 2022] GET /compute/v2.1/servers/02869b36-2e27-488f-9e94-c82e7094038d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:40.213117 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:40.221336 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-abb53e79-5d94-4f1a-8073-7df8156add76 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1453 microversion: 2.1 time: 0.218905 Aug 24 04:55:40.221914 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 434/929] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:40 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1453 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:40.246955 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:40.247836 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:40.255167 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.256712 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.256998 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.258268 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.258731 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.259157 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.260945 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:40.262249 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:40.288867 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.289582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.290190 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.291134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.292562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.293386 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.576458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:40.582037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:40.586066 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c7a61906-8277-49b6-9b36-10de6b28f5d2 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1453 microversion: 2.1 time: 0.342412 Aug 24 04:55:40.586417 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 496/930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:40 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1453 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:40.592426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:40.594038 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:40.595166 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-528ac662-4de7-4146-9ac1-c0ccf1efd351 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1739 microversion: 2.20 time: 0.341999 Aug 24 04:55:40.595721 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 435/931] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:40 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:41.194260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2256bf92-8886-4b42-a766-05a51cec2c20 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "022f0372-519f-42d2-a159-dec730f4abe2"}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:41.197427 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2256bf92-8886-4b42-a766-05a51cec2c20 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:41.204597 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2256bf92-8886-4b42-a766-05a51cec2c20 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:41.205413 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2256bf92-8886-4b42-a766-05a51cec2c20 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:41.205927 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2256bf92-8886-4b42-a766-05a51cec2c20 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:41.206730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2256bf92-8886-4b42-a766-05a51cec2c20 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:41.207257 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2256bf92-8886-4b42-a766-05a51cec2c20 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:41.208336 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2256bf92-8886-4b42-a766-05a51cec2c20 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:41.223227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:41.524909 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2256bf92-8886-4b42-a766-05a51cec2c20 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "POST /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334713 Aug 24 04:55:41.526299 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 497/932] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 24 04:55:41 2022] POST /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:41.620193 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:41.621587 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:41.637110 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:41.638848 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:41.639529 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:41.643474 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:41.664386 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:41.667007 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:41.959983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:41.969058 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:41.970616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:41.972150 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2fd56f39-0f95-4737-afe8-524344445d60 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1721 microversion: 2.20 time: 0.357004 Aug 24 04:55:41.972925 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 436/933] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:41 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:42.570032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-6d65027f-56c5-4414-a515-39099f3a0e48 req-271c801c-816c-4999-8809-3fef1f7828e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa50707e-0efd-4a9e-be1c-b2abfc2b1160", "tag": "7a40828b-ec56-4289-bf85-8dd64624ce3f"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:42.581345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6d65027f-56c5-4414-a515-39099f3a0e48 req-271c801c-816c-4999-8809-3fef1f7828e4 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:42.581826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6d65027f-56c5-4414-a515-39099f3a0e48 req-271c801c-816c-4999-8809-3fef1f7828e4 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:42.582715 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6d65027f-56c5-4414-a515-39099f3a0e48 req-271c801c-816c-4999-8809-3fef1f7828e4 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:42.596208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-6d65027f-56c5-4414-a515-39099f3a0e48 req-271c801c-816c-4999-8809-3fef1f7828e4 service nova] Creating event network-changed:7a40828b-ec56-4289-bf85-8dd64624ce3f for instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 on hv-cinder-85426 Aug 24 04:55:42.601353 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-6d65027f-56c5-4414-a515-39099f3a0e48 req-271c801c-816c-4999-8809-3fef1f7828e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036589 Aug 24 04:55:42.601956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 498/934] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:42.998417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:42.999915 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:43.011656 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:43.012994 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:43.013948 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:43.015475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:43.016845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:43.017608 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:43.284085 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:43.306491 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:43.310444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:43.313525 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b828821b-42bd-4f55-8c98-ab096ea3aa58 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1721 microversion: 2.20 time: 0.318909 Aug 24 04:55:43.330988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 437/935] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:42 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:44.348799 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:44.350216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:44.362037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:44.362831 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:44.363451 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:44.364650 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:44.370646 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:44.371394 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:44.525905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:44.535514 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:44.540170 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:44.541938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9d150d66-f617-4bae-bc13-23455e1386c4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1721 microversion: 2.20 time: 0.198760 Aug 24 04:55:44.544871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 499/936] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:44 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:45.357651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-9f3722eb-57fa-46fb-84ff-d0a43c68700c req-35281a9f-97e7-4415-9d59-8524f3fcba81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25850e86-d01f-489f-b7be-a04e7854041b", "name": "network-vif-unplugged", "status": "completed", "tag": "c95760a7-3a19-4223-bc23-f813a2768a06"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:45.375749 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:45.379140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-9f3722eb-57fa-46fb-84ff-d0a43c68700c req-35281a9f-97e7-4415-9d59-8524f3fcba81 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:45.380096 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-9f3722eb-57fa-46fb-84ff-d0a43c68700c req-35281a9f-97e7-4415-9d59-8524f3fcba81 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:45.381695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-9f3722eb-57fa-46fb-84ff-d0a43c68700c req-35281a9f-97e7-4415-9d59-8524f3fcba81 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:45.400914 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.compute.server_external_events [req-9f3722eb-57fa-46fb-84ff-d0a43c68700c req-35281a9f-97e7-4415-9d59-8524f3fcba81 service nova] Unable to find a host for instance 25850e86-d01f-489f-b7be-a04e7854041b. Dropping event network-vif-unplugged {{(pid=127416) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 04:55:45.402258 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-9f3722eb-57fa-46fb-84ff-d0a43c68700c req-35281a9f-97e7-4415-9d59-8524f3fcba81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050948 Aug 24 04:55:45.403898 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 438/937] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 04:55:45.573757 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:45.575757 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:45.589660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:45.591208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:45.592488 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:45.593845 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:45.594820 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:45.597263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:45.968163 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:45.978424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:45.980129 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:45.981368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-eeb48f73-6f0f-4ecd-ae46-e68e3788d001 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1664 microversion: 2.20 time: 0.417531 Aug 24 04:55:45.982026 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 500/938] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:45 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1664 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:46.006664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-34687238-6ef3-4a39-94e4-27818e5598be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf437c58-1333-4d44-862b-5a5c1b39f09d"}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:46.009283 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-34687238-6ef3-4a39-94e4-27818e5598be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:46.019279 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34687238-6ef3-4a39-94e4-27818e5598be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:46.019862 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34687238-6ef3-4a39-94e4-27818e5598be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:46.020360 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34687238-6ef3-4a39-94e4-27818e5598be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:46.021201 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34687238-6ef3-4a39-94e4-27818e5598be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:46.021926 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34687238-6ef3-4a39-94e4-27818e5598be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:46.022350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-34687238-6ef3-4a39-94e4-27818e5598be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:46.327940 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-34687238-6ef3-4a39-94e4-27818e5598be tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326557 Aug 24 04:55:46.328545 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 439/939] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Aug 24 04:55:45 2022] POST /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:55:46.467735 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-71e444f7-6af1-4627-8425-c2294472acae tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:46.468344 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-71e444f7-6af1-4627-8425-c2294472acae tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:46.475946 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-71e444f7-6af1-4627-8425-c2294472acae tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:46.476443 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-71e444f7-6af1-4627-8425-c2294472acae tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:46.476947 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-71e444f7-6af1-4627-8425-c2294472acae tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:46.477655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-71e444f7-6af1-4627-8425-c2294472acae tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:46.478422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-71e444f7-6af1-4627-8425-c2294472acae tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:46.478537 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-71e444f7-6af1-4627-8425-c2294472acae tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:48.464693 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-71e444f7-6af1-4627-8425-c2294472acae tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/os-volume_attachments/cf437c58-1333-4d44-862b-5a5c1b39f09d" status: 202 len: 0 microversion: 2.20 time: 2.001013 Aug 24 04:55:48.465920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 501/940] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Aug 24 04:55:46 2022] DELETE /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/os-volume_attachments/cf437c58-1333-4d44-862b-5a5c1b39f09d => generated 0 bytes in 2002 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:55:48.540260 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:48.541183 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:48.548012 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:48.548502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:48.548938 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:48.549636 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:48.550114 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:48.550563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:48.610744 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127416) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 04:55:48.688849 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:48.712662 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b298a1b5-94cc-4248-8ba4-8807f06bf2ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "POST /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/action" status: 202 len: 0 microversion: 2.20 time: 0.176319 Aug 24 04:55:48.714750 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 440/941] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 24 04:55:48 2022] POST /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:55:48.721944 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:48.722700 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:48.732707 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:48.733391 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:48.733904 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:48.735180 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:48.735859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:48.736530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:48.928525 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:48.944692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:48.948802 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:48.950923 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b898d04b-f524-4112-a844-21f8c11d1403 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1672 microversion: 2.20 time: 0.233375 Aug 24 04:55:48.951733 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 502/942] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:48 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:49.982183 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:49.984019 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:49.992416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:49.993189 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:49.994065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:49.994962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:49.995563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:49.996127 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:50.193239 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:50.205015 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:50.223038 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:50.224692 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5c4432fd-e11b-4048-82ae-0b8e7c1070b5 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.248771 Aug 24 04:55:50.225401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 441/943] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:49 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:51.248750 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:51.249520 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:51.257188 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:51.257699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:51.258185 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:51.258903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:51.259706 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:51.259827 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:51.409636 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:51.422704 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:51.424817 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:51.426168 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1f415c1b-7de0-4efd-867f-51746be15617 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.181268 Aug 24 04:55:51.427173 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 503/944] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:51 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:52.450815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:52.451490 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:52.458522 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:52.459067 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:52.459739 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:52.460563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:52.461125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:52.461622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:52.625297 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:52.633896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:52.635581 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:52.636752 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-51abb477-4148-4ffd-8104-f998c7ee6b48 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.189889 Aug 24 04:55:52.637304 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 442/945] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:52 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:53.663158 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:53.663781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:53.670854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:53.671350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:53.671792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:53.672528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:53.673206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:53.673666 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:53.825225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:53.835132 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:53.836672 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:53.837842 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ca1f76a5-e133-460c-946f-83be48ab7c2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.180716 Aug 24 04:55:53.838465 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 504/946] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:53 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:54.860877 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:54.862425 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:54.874532 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:54.875428 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:54.876199 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:54.877519 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:54.879350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:54.880636 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:54.967254 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:54.967854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:54.975309 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:54.975797 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:54.976233 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:54.976928 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:54.977378 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:54.977797 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:55.047430 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:55.058632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:55.060264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:55.061908 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b95d93cd-7e21-4209-b90e-d3909e2a682b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.205132 Aug 24 04:55:55.062827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 443/947] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:54 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:55.107923 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lazy-loading 'services' on Instance uuid 4eb4ee39-2853-46cf-8706-1763a7c6f91a {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:55.234384 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0dda2a2b-6d9e-468a-b777-903902507098 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments/022f0372-519f-42d2-a159-dec730f4abe2" status: 202 len: 0 microversion: 2.1 time: 0.270634 Aug 24 04:55:55.235461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 505/948] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 24 04:55:54 2022] DELETE /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments/022f0372-519f-42d2-a159-dec730f4abe2 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:55:55.247977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c7a4e259-fdb1-4b29-af1f-cb79218dcdb4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:55.251426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c7a4e259-fdb1-4b29-af1f-cb79218dcdb4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:55.261063 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a4e259-fdb1-4b29-af1f-cb79218dcdb4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:55.261919 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a4e259-fdb1-4b29-af1f-cb79218dcdb4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:55.262626 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a4e259-fdb1-4b29-af1f-cb79218dcdb4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:55.263404 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a4e259-fdb1-4b29-af1f-cb79218dcdb4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:55.263943 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a4e259-fdb1-4b29-af1f-cb79218dcdb4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:55.264454 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c7a4e259-fdb1-4b29-af1f-cb79218dcdb4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:55.301151 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c7a4e259-fdb1-4b29-af1f-cb79218dcdb4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060962 Aug 24 04:55:55.301846 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 444/949] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:55 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:56.089558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:56.090286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:56.097006 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:56.097496 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:56.097946 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:56.098686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:56.099331 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:56.099997 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:56.282751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:56.296174 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:56.300034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:56.302708 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a6acb7f4-c4b1-4575-897b-9ce8bb4095cf tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.218942 Aug 24 04:55:56.304602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 506/950] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:56 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:55:56.324441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-60e2b718-8ef4-4525-a230-eda011c8ef63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:56.329683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-60e2b718-8ef4-4525-a230-eda011c8ef63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:56.343426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-60e2b718-8ef4-4525-a230-eda011c8ef63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:56.344646 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-60e2b718-8ef4-4525-a230-eda011c8ef63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:56.345825 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-60e2b718-8ef4-4525-a230-eda011c8ef63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:56.347097 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-60e2b718-8ef4-4525-a230-eda011c8ef63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:56.347976 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-60e2b718-8ef4-4525-a230-eda011c8ef63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:56.348595 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-60e2b718-8ef4-4525-a230-eda011c8ef63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:56.406907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-60e2b718-8ef4-4525-a230-eda011c8ef63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092126 Aug 24 04:55:56.407775 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 445/951] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:56 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:57.351470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:57.353811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:57.361784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:57.362428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:57.362974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:57.363765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:57.364333 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:57.364835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:57.420891 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-96478818-f6cf-4665-a447-65a481a72f2e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:57.424168 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-96478818-f6cf-4665-a447-65a481a72f2e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:57.431997 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96478818-f6cf-4665-a447-65a481a72f2e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:57.432748 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96478818-f6cf-4665-a447-65a481a72f2e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:57.433329 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96478818-f6cf-4665-a447-65a481a72f2e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:57.434262 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96478818-f6cf-4665-a447-65a481a72f2e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:57.434891 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96478818-f6cf-4665-a447-65a481a72f2e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:57.435472 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-96478818-f6cf-4665-a447-65a481a72f2e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:57.473720 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-96478818-f6cf-4665-a447-65a481a72f2e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056736 Aug 24 04:55:57.475320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 446/952] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:57 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:57.547314 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:57.561388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:57.564011 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:57.565835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ea440b50-d850-4f88-b31f-c0c8d984ba76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.222136 Aug 24 04:55:57.566488 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 507/953] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:57 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:58.487542 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-58874370-ef78-4f36-afcd-1175f847c147 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:58.490481 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-58874370-ef78-4f36-afcd-1175f847c147 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:58.498505 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-58874370-ef78-4f36-afcd-1175f847c147 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:58.499125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-58874370-ef78-4f36-afcd-1175f847c147 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:58.499477 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-58874370-ef78-4f36-afcd-1175f847c147 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:58.500921 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-58874370-ef78-4f36-afcd-1175f847c147 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:58.500921 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-58874370-ef78-4f36-afcd-1175f847c147 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:58.501512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-58874370-ef78-4f36-afcd-1175f847c147 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:58.533414 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-58874370-ef78-4f36-afcd-1175f847c147 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050182 Aug 24 04:55:58.533991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 447/954] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:58 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:58.593436 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:58.595034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:58.603187 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:58.603902 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:58.604269 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:58.604990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:58.605448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:58.605874 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:58.792042 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:58.804432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:58.806486 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:58.808034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-10263c58-55cc-4e92-93e7-658cb7cbedfc tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.221115 Aug 24 04:55:58.824680 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 508/955] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:58 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:55:59.548214 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e5bf8c19-8cd3-4c6e-b4d3-bd6798f4de77 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:59.551155 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e5bf8c19-8cd3-4c6e-b4d3-bd6798f4de77 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:59.558738 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e5bf8c19-8cd3-4c6e-b4d3-bd6798f4de77 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:59.559586 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e5bf8c19-8cd3-4c6e-b4d3-bd6798f4de77 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:59.560259 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e5bf8c19-8cd3-4c6e-b4d3-bd6798f4de77 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:59.561213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e5bf8c19-8cd3-4c6e-b4d3-bd6798f4de77 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:59.561881 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e5bf8c19-8cd3-4c6e-b4d3-bd6798f4de77 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:59.562552 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e5bf8c19-8cd3-4c6e-b4d3-bd6798f4de77 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:59.602800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e5bf8c19-8cd3-4c6e-b4d3-bd6798f4de77 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059538 Aug 24 04:55:59.606491 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 448/956] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:59 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:59.832352 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:59.833972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:59.841970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:59.842873 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:59.843577 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:59.844544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:59.845248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:59.845905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:00.015297 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:00.029367 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:00.031320 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:00.032745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-beb7aa2d-afd9-4940-adc1-ee090bba919b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.204325 Aug 24 04:56:00.033498 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 509/957] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:55:59 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:56:00.622301 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4040d436-e927-406b-99c1-79b235ef44a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:00.624618 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4040d436-e927-406b-99c1-79b235ef44a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:00.634755 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4040d436-e927-406b-99c1-79b235ef44a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:00.635765 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4040d436-e927-406b-99c1-79b235ef44a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:00.636562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4040d436-e927-406b-99c1-79b235ef44a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:00.637903 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4040d436-e927-406b-99c1-79b235ef44a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:00.638985 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4040d436-e927-406b-99c1-79b235ef44a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:00.640067 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4040d436-e927-406b-99c1-79b235ef44a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:00.687766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4040d436-e927-406b-99c1-79b235ef44a4 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069489 Aug 24 04:56:00.688361 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 449/958] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:56:00 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:01.058319 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:01.058867 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:01.065498 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:01.065987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:01.066472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:01.067171 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:01.067629 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:01.072091 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:01.072887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:01.230502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:01.239067 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:01.241114 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:01.242391 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-55f9c526-8e7e-4aa6-bd51-515d50ba1a2f tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.189060 Aug 24 04:56:01.243026 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 510/959] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:01 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:01.700473 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9c0e0d8d-afb2-4990-ba26-8a15ac7cad9a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:01.702798 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9c0e0d8d-afb2-4990-ba26-8a15ac7cad9a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:01.712793 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c0e0d8d-afb2-4990-ba26-8a15ac7cad9a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:01.713641 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c0e0d8d-afb2-4990-ba26-8a15ac7cad9a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:01.714424 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c0e0d8d-afb2-4990-ba26-8a15ac7cad9a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:01.715724 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c0e0d8d-afb2-4990-ba26-8a15ac7cad9a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:01.716576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c0e0d8d-afb2-4990-ba26-8a15ac7cad9a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:01.717295 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9c0e0d8d-afb2-4990-ba26-8a15ac7cad9a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:01.786657 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9c0e0d8d-afb2-4990-ba26-8a15ac7cad9a tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089678 Aug 24 04:56:01.788483 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 450/960] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:56:01 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:02.267905 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:02.268529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:02.275473 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:02.275950 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:02.276381 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:02.277113 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:02.277593 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:02.278028 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:02.442686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:02.457289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:02.460725 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:02.462394 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9bdaf0f1-b6e8-4389-84ca-3f9eb28e52ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.199462 Aug 24 04:56:02.463150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 511/961] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:02 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:02.801728 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-99f5507b-9cc8-45a1-8509-107d91cea2fa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:02.804746 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-99f5507b-9cc8-45a1-8509-107d91cea2fa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:02.813832 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-99f5507b-9cc8-45a1-8509-107d91cea2fa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:02.814367 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-99f5507b-9cc8-45a1-8509-107d91cea2fa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:02.814807 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-99f5507b-9cc8-45a1-8509-107d91cea2fa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:02.815528 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-99f5507b-9cc8-45a1-8509-107d91cea2fa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:02.815984 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-99f5507b-9cc8-45a1-8509-107d91cea2fa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:02.816410 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-99f5507b-9cc8-45a1-8509-107d91cea2fa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:02.851273 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-99f5507b-9cc8-45a1-8509-107d91cea2fa tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054041 Aug 24 04:56:02.851863 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 451/962] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:56:02 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:03.491799 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:03.492835 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:03.506956 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:03.508975 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:03.510303 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:03.512101 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:03.512916 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:03.513603 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:03.684150 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:03.693532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:03.695119 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:03.696380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d35a4725-19d5-480c-8639-7b8fa61365cd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.212668 Aug 24 04:56:03.696996 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 512/963] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:03 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:03.865459 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-991a6219-7547-4c78-ab1a-38402b487a63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:03.867704 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-991a6219-7547-4c78-ab1a-38402b487a63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:03.874394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-991a6219-7547-4c78-ab1a-38402b487a63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:03.874882 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-991a6219-7547-4c78-ab1a-38402b487a63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:03.875323 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-991a6219-7547-4c78-ab1a-38402b487a63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:03.876022 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-991a6219-7547-4c78-ab1a-38402b487a63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:03.876477 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-991a6219-7547-4c78-ab1a-38402b487a63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:03.876899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-991a6219-7547-4c78-ab1a-38402b487a63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:03.911250 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-991a6219-7547-4c78-ab1a-38402b487a63 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050273 Aug 24 04:56:03.911929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 452/964] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:56:03 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:04.719655 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:04.720309 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:04.725865 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=54 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:04.731648 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:04.732130 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:04.732635 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:04.733283 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:04.733679 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:04.734151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:04.885746 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:04.915610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:04.918444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:04.923811 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-901a2f73-6851-4bc2-a583-a7da7f01b0cf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:04.925303 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3ebaa634-758b-49ac-8dc6-f45d8b345cfd tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.202797 Aug 24 04:56:04.926311 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 513/965] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:04 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:04.926425 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-901a2f73-6851-4bc2-a583-a7da7f01b0cf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:04.946813 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-901a2f73-6851-4bc2-a583-a7da7f01b0cf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:04.947584 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-901a2f73-6851-4bc2-a583-a7da7f01b0cf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:04.948179 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-901a2f73-6851-4bc2-a583-a7da7f01b0cf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:04.949069 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-901a2f73-6851-4bc2-a583-a7da7f01b0cf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:04.949746 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-901a2f73-6851-4bc2-a583-a7da7f01b0cf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:04.950267 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-901a2f73-6851-4bc2-a583-a7da7f01b0cf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:04.987195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-901a2f73-6851-4bc2-a583-a7da7f01b0cf tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067316 Aug 24 04:56:04.988033 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 453/966] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:56:04 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:05.462947 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:56:05.463205 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Wed Aug 24 04:56:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:56:05.951742 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:05.952385 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:05.959557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:05.960063 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:05.960482 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:05.961180 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:05.961628 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:05.962249 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:06.000004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-97dcc215-6447-44f9-b4af-8bead3a91387 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:06.002182 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-97dcc215-6447-44f9-b4af-8bead3a91387 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:06.009061 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-97dcc215-6447-44f9-b4af-8bead3a91387 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:06.009543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-97dcc215-6447-44f9-b4af-8bead3a91387 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:06.009971 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-97dcc215-6447-44f9-b4af-8bead3a91387 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:06.010692 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-97dcc215-6447-44f9-b4af-8bead3a91387 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:06.011142 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-97dcc215-6447-44f9-b4af-8bead3a91387 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:06.011562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-97dcc215-6447-44f9-b4af-8bead3a91387 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:06.043559 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-97dcc215-6447-44f9-b4af-8bead3a91387 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047036 Aug 24 04:56:06.044575 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 454/967] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:56:05 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:56:06.147053 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:06.155638 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:06.157165 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:06.158358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-25a39256-346d-45f7-bb82-303698ced006 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.210792 Aug 24 04:56:06.158920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 514/968] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:05 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:07.059832 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-b72e1b5c-3709-4e4f-9b13-32593b84f7ce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:07.062024 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-b72e1b5c-3709-4e4f-9b13-32593b84f7ce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:07.070595 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b72e1b5c-3709-4e4f-9b13-32593b84f7ce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:07.071086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b72e1b5c-3709-4e4f-9b13-32593b84f7ce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:07.071522 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b72e1b5c-3709-4e4f-9b13-32593b84f7ce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:07.072232 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b72e1b5c-3709-4e4f-9b13-32593b84f7ce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:07.072686 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b72e1b5c-3709-4e4f-9b13-32593b84f7ce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:07.073124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-b72e1b5c-3709-4e4f-9b13-32593b84f7ce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:07.109207 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-b72e1b5c-3709-4e4f-9b13-32593b84f7ce tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053235 Aug 24 04:56:07.109785 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 455/969] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:56:07 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:07.182039 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:07.182652 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:07.189630 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:07.190165 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:07.190606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:07.191316 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:07.191774 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:07.192207 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:07.340163 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:07.349325 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:07.350999 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:07.352262 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-868abc16-3d9e-469d-ba6c-83feb9e308ec tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.174228 Aug 24 04:56:07.352987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 515/970] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:07 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:08.122308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5a788b75-fb09-4c1b-b58a-cf7aa849ff9e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:08.124479 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5a788b75-fb09-4c1b-b58a-cf7aa849ff9e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:08.131487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5a788b75-fb09-4c1b-b58a-cf7aa849ff9e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:08.132017 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5a788b75-fb09-4c1b-b58a-cf7aa849ff9e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:08.132464 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5a788b75-fb09-4c1b-b58a-cf7aa849ff9e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:08.133170 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5a788b75-fb09-4c1b-b58a-cf7aa849ff9e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:08.133630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5a788b75-fb09-4c1b-b58a-cf7aa849ff9e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:08.134088 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5a788b75-fb09-4c1b-b58a-cf7aa849ff9e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:08.166087 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5a788b75-fb09-4c1b-b58a-cf7aa849ff9e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047804 Aug 24 04:56:08.166586 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 456/971] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:56:08 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:56:08.375685 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:08.377126 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:08.384699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:08.385182 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:08.385610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:08.386528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:08.387816 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:08.387816 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:08.621932 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:08.632364 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:08.635034 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:08.636633 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3d9d2759-81c9-4be4-86bd-66cccfc030d0 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.264731 Aug 24 04:56:08.639821 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 516/972] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:08 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:09.179117 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-76fdef87-30ff-49a6-804d-3b9a92356696 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:09.182427 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-76fdef87-30ff-49a6-804d-3b9a92356696 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:09.197605 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-76fdef87-30ff-49a6-804d-3b9a92356696 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.198128 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-76fdef87-30ff-49a6-804d-3b9a92356696 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.198777 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-76fdef87-30ff-49a6-804d-3b9a92356696 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.199952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-76fdef87-30ff-49a6-804d-3b9a92356696 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.200769 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-76fdef87-30ff-49a6-804d-3b9a92356696 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.201348 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-76fdef87-30ff-49a6-804d-3b9a92356696 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.220904 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=100 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:09.236785 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-76fdef87-30ff-49a6-804d-3b9a92356696 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063191 Aug 24 04:56:09.237991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 457/973] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 24 04:56:09 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:56:09.317350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:09.318573 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:09.325609 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.326778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.326778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.327249 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.327917 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.328541 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.363309 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:56:09.450980 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-06a5d567-8932-4bde-bfa7-d9b56d8000d3 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 204 len: 0 microversion: 2.1 time: 0.137074 Aug 24 04:56:09.451810 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 517/974] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:56:09 2022] DELETE /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:56:09.461056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:09.462669 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:09.470667 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.471709 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.472210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.473196 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.474286 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.475054 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.633836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:09.644821 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-40adb681-ccae-4667-adfc-1b75038a3c8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1679 microversion: 2.1 time: 0.188171 Aug 24 04:56:09.645522 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 458/975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:09 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:09.680351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:09.681206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:09.687779 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.688784 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.689195 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.690109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.690568 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.691319 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.701962 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-dd1bd890-057f-429a-8a0b-df3a7bbc4535 req-6a62e834-59c9-401c-8b9c-b94c0a55c29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25850e86-d01f-489f-b7be-a04e7854041b", "name": "network-vif-plugged", "status": "completed", "tag": "c95760a7-3a19-4223-bc23-f813a2768a06"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:09.721850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-dd1bd890-057f-429a-8a0b-df3a7bbc4535 req-6a62e834-59c9-401c-8b9c-b94c0a55c29d service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.722983 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-dd1bd890-057f-429a-8a0b-df3a7bbc4535 req-6a62e834-59c9-401c-8b9c-b94c0a55c29d service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.723634 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-dd1bd890-057f-429a-8a0b-df3a7bbc4535 req-6a62e834-59c9-401c-8b9c-b94c0a55c29d service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.755185 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-dd1bd890-057f-429a-8a0b-df3a7bbc4535 req-6a62e834-59c9-401c-8b9c-b94c0a55c29d service nova] Creating event network-vif-plugged:c95760a7-3a19-4223-bc23-f813a2768a06 for instance 25850e86-d01f-489f-b7be-a04e7854041b on hv-cinder-85426 Aug 24 04:56:09.765815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-dd1bd890-057f-429a-8a0b-df3a7bbc4535 req-6a62e834-59c9-401c-8b9c-b94c0a55c29d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069614 Aug 24 04:56:09.767964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 459/976] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:09.866491 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:09.875148 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:09.876855 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:09.878321 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-88df4b4a-d0a2-4f41-9cae-ec5894a4ce41 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.204189 Aug 24 04:56:09.878961 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 518/977] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:09 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:10.672974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:10.673713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:10.681343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:10.681813 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:10.682273 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:10.682970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:10.683416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:10.683835 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:10.837202 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:10.845244 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3b06b76f-c59d-49ea-8a44-2aaf0a7e03ae tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1679 microversion: 2.1 time: 0.176769 Aug 24 04:56:10.845742 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 460/978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:10 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:10.902861 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:10.903735 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:10.910550 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:10.911040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:10.911572 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:10.912288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:10.912748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:10.913219 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:11.056698 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:11.065863 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:11.067454 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:11.069576 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-271eb3b2-8f5a-4920-a610-c2af2898b9d4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.170697 Aug 24 04:56:11.070174 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 519/979] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:10 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:11.869272 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:11.870918 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:11.878619 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:11.879353 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:11.880039 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:11.881707 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:11.882412 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:11.882988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:12.094315 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:12.094984 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:12.106908 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:12.107771 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:12.108403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:12.110712 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:12.111371 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:12.112151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:12.185885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:12.197056 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d660540a-653a-4d07-807e-ec8198cd7b26 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1679 microversion: 2.1 time: 0.330718 Aug 24 04:56:12.198579 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 461/980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:11 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1679 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:12.352503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:12.362430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:12.366081 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:12.368151 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a8a00f17-1115-4234-9cee-6577b2aac96e tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.278592 Aug 24 04:56:12.368790 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 520/981] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:12 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:12.740579 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-26b14a61-d1f8-4b9a-8952-772c39529a09 req-c0dd08ce-3f5f-4424-9c2b-f9db8cacf7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb4ee39-2853-46cf-8706-1763a7c6f91a", "name": "network-vif-deleted", "tag": "c1d66fe8-b698-430e-b942-010dff2a7984"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:12.753844 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-26b14a61-d1f8-4b9a-8952-772c39529a09 req-c0dd08ce-3f5f-4424-9c2b-f9db8cacf7fb service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:12.754757 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-26b14a61-d1f8-4b9a-8952-772c39529a09 req-c0dd08ce-3f5f-4424-9c2b-f9db8cacf7fb service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:12.755615 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-26b14a61-d1f8-4b9a-8952-772c39529a09 req-c0dd08ce-3f5f-4424-9c2b-f9db8cacf7fb service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:12.986403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-26b14a61-d1f8-4b9a-8952-772c39529a09 req-c0dd08ce-3f5f-4424-9c2b-f9db8cacf7fb service nova] Creating event network-vif-deleted:c1d66fe8-b698-430e-b942-010dff2a7984 for instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a on hv-cinder-85426 Aug 24 04:56:12.993374 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-26b14a61-d1f8-4b9a-8952-772c39529a09 req-c0dd08ce-3f5f-4424-9c2b-f9db8cacf7fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262139 Aug 24 04:56:12.994186 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 462/982] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:13.220710 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:13.221534 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:13.229252 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:13.230025 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:13.230603 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:13.231461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:13.232284 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:13.232730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:13.274135 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:13.274939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:13.275542 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:13.276153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.objects.instance [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lazy-loading 'fault' on Instance uuid 4eb4ee39-2853-46cf-8706-1763a7c6f91a {{(pid=127415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:56:13.393218 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:13.394081 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:13.394226 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b847f94abee2439fab2f85f48abd7707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9c64fe66a8438eb31c22925ff62994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:13.404943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3c03ddf6-6629-4453-9f5f-eb346df1a96e tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 200 len: 1331 microversion: 2.1 time: 0.187938 Aug 24 04:56:13.407028 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:13.413137 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:13.414088 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:13.415129 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:13.415856 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:13.416561 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:13.424575 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 521/983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:13 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 1331 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:13.769994 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:13.780102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:13.781808 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:13.783049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e4e81a59-9869-4745-9cbf-5e02d7712fd6 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1730 microversion: 2.20 time: 0.394994 Aug 24 04:56:13.790897 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 463/984] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:13 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1730 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:56:14.433941 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:14.435429 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:14.446179 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:14.449480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:14.449930 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:14.450863 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:14.451450 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:14.451975 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:14.472569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a HTTP/1.1 Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:56:14.474318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:14.475862 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '4eb4ee39-2853-46cf-8706-1763a7c6f91a'} Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:14.476807 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:14.479401 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:14.483723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:14.484918 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5f24ef17-1f6f-44fd-b6f7-8bbec5187922 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 404 len: 111 microversion: 2.1 time: 0.056843 Aug 24 04:56:14.485657 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 522/985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:14 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:14.495377 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ff131e12-aa2e-459d-8313-93bc06fb0cff tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '.version_select at 0x7fb0507f1550>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:14.518350 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ff131e12-aa2e-459d-8313-93bc06fb0cff tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615035593" status: 202 len: 0 microversion: 2.1 time: 0.027162 Aug 24 04:56:14.519195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 464/986] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 24 04:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615035593 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:56:14.815311 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:14.816052 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:14.829029 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:14.830093 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:14.831124 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:14.832498 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:14.833325 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:14.834778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:15.027503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:15.037031 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:15.039311 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:15.040786 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0db8fe67-f450-4c66-bdfe-160780cc0d14 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1717 microversion: 2.20 time: 0.229942 Aug 24 04:56:15.041638 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 523/987] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:14 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1717 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:16.551142 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:16.551142 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:16.552184 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:16.564593 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:16.564593 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:16.564593 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:16.566671 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:16.566856 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:16.568523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:16.585403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: DELETE /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a HTTP/1.1 Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:56:16.587140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.589289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '4eb4ee39-2853-46cf-8706-1763a7c6f91a'} Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:16.590909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.592869 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.594928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:16.594928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c0952434-31d7-4b52-81cd-0ce01f0c27e7 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 404 len: 111 microversion: 2.1 time: 0.044949 Aug 24 04:56:16.594928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 465/988] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:56:16 2022] DELETE /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:16.599109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:16.599800 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4eb4ee39-2853-46cf-8706-1763a7c6f91a] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:16.607603 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:16.608347 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:16.609064 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:16.609662 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:16.610470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:16.610900 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:16.625890 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a HTTP/1.1 Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:56:16.627480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.631208 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '4eb4ee39-2853-46cf-8706-1763a7c6f91a'} Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:16.633879 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. Aug 24 04:56:16.636393 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:16.641358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance 4eb4ee39-2853-46cf-8706-1763a7c6f91a could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:16.641358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-54a8b717-df35-4344-a21d-00f6600ec335 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a" status: 404 len: 111 microversion: 2.1 time: 0.034684 Aug 24 04:56:16.641358 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 524/989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:16 2022] GET /compute/v2.1/servers/4eb4ee39-2853-46cf-8706-1763a7c6f91a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:17.833769 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:17.834471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:17.841102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:17.841585 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:17.842046 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:17.842761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:17.843215 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:17.843644 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:17.858335 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: DELETE /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c HTTP/1.1 Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:56:17.859913 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.861411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': 'a0b95f69-cad3-4702-ae63-d4236e2d414c'} Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:17.862242 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.863484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.866140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:17.866140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2e471529-c6b1-4d9b-b94c-a55b7b33ea98 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 404 len: 111 microversion: 2.1 time: 0.031445 Aug 24 04:56:17.866140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 466/990] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:56:17 2022] DELETE /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:17.870972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:17.871854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: a0b95f69-cad3-4702-ae63-d4236e2d414c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:17.878077 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:17.878570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:17.879070 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:17.879778 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:17.880263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:17.880806 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:17.894917 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c HTTP/1.1 Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:56:17.896479 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.898189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': 'a0b95f69-cad3-4702-ae63-d4236e2d414c'} Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:17.899117 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. Aug 24 04:56:17.900632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.901990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance a0b95f69-cad3-4702-ae63-d4236e2d414c could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:17.901990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-65b74d56-3d19-4bfb-8c0b-7a3eda4e4d85 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c" status: 404 len: 111 microversion: 2.1 time: 0.030964 Aug 24 04:56:17.901990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 525/991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:17 2022] GET /compute/v2.1/servers/a0b95f69-cad3-4702-ae63-d4236e2d414c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:17.907799 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:17.908286 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:17.915387 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:17.915899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:17.916327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:17.917021 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:17.917466 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:17.917922 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:17.932513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: DELETE /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 HTTP/1.1 Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:56:17.934086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.935696 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '4b427776-20b2-4c84-bf77-7049937303f6'} Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:17.936603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.938275 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.939915 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:17.939915 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5fb182ad-4141-4ae3-bea8-4edefb1e6966 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 404 len: 111 microversion: 2.1 time: 0.031648 Aug 24 04:56:17.939915 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 467/992] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:56:17 2022] DELETE /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:17.943841 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:17.944435 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: 4b427776-20b2-4c84-bf77-7049937303f6] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:17.950371 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:17.950939 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:17.951277 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:17.951999 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:17.952399 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:17.952820 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:17.966473 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 HTTP/1.1 Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:56:17.968032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.969702 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '4b427776-20b2-4c84-bf77-7049937303f6'} Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:17.970822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. Aug 24 04:56:17.972406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:17.975112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance 4b427776-20b2-4c84-bf77-7049937303f6 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:17.975112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-be84c9e7-a949-407d-ac45-7cb9d8628e8b tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6" status: 404 len: 111 microversion: 2.1 time: 0.029328 Aug 24 04:56:17.975112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 526/993] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:17 2022] GET /compute/v2.1/servers/4b427776-20b2-4c84-bf77-7049937303f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:56:19.111861 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:19.112379 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:19.120318 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:19.120970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:19.121677 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:19.122591 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:19.123206 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:19.124147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:19.139576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: DELETE /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 HTTP/1.1 Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:56:19.141616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.143712 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': 'f79fe8ef-51d0-4ca2-9e41-940ee142b819'} Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:19.144792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.147049 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.149390 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:19.150292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-fe6c995c-30ef-4837-a04d-d9ec949226d9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 404 len: 111 microversion: 2.1 time: 0.042400 Aug 24 04:56:19.150857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 468/994] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:56:19 2022] DELETE /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:19.159418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:19.160022 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] [instance: f79fe8ef-51d0-4ca2-9e41-940ee142b819] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:19.167470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:19.168019 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:19.168379 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:19.169080 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:19.169531 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:19.169948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:19.185464 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] HTTP exception thrown: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Request method failure captured: Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 HTTP/1.1 Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa3I_1P5XKJMeTmlvXmmefcp-BEDN7XbUexX3VVdh5jzaLXB_mhHwOVIMDYD9khcvgX1Lj66Pcr_iWJ7XVxLAeJa0NvWIvH8xuXGz1AeWjPXA2xIlX3zqXIOT_GXOth2tgqHQxcsTJlbexZvAWdoLUfZSTYF5zrSJVoGCtKlmiADpYs Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:56:19.187350 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e9c64fe66a8438eb31c22925ff62994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e9c64fe66a8438eb31c22925ff62994"}]}] Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 1e9c64fe66a8438eb31c22925ff62994 Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1248856240 Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: b847f94abee2439fab2f85f48abd7707 Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeNegativeTest-1248856240-project Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.188858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': 'f79fe8ef-51d0-4ca2-9e41-940ee142b819'} Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:19.189660 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. Aug 24 04:56:19.191313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:19.192526 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] Returning 404 to user: Instance f79fe8ef-51d0-4ca2-9e41-940ee142b819 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:19.192526 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5d6b17dd-261b-471e-a529-19aa69a28fc9 tempest-AttachVolumeNegativeTest-1248856240 tempest-AttachVolumeNegativeTest-1248856240-project] 10.222.0.60 "GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819" status: 404 len: 111 microversion: 2.1 time: 0.033270 Aug 24 04:56:19.192526 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 527/995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:19 2022] GET /compute/v2.1/servers/f79fe8ef-51d0-4ca2-9e41-940ee142b819 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:56:48.249993 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-542b784b-5e80-46a8-94e3-838a9df13ec9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:48.252123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-542b784b-5e80-46a8-94e3-838a9df13ec9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:48.255480 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=7 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:48.255480 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=38 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:48.262360 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-542b784b-5e80-46a8-94e3-838a9df13ec9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:48.262850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-542b784b-5e80-46a8-94e3-838a9df13ec9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:48.263278 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-542b784b-5e80-46a8-94e3-838a9df13ec9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:48.263993 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-542b784b-5e80-46a8-94e3-838a9df13ec9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:48.264445 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-542b784b-5e80-46a8-94e3-838a9df13ec9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:48.264866 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-542b784b-5e80-46a8-94e3-838a9df13ec9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:48.297649 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-542b784b-5e80-46a8-94e3-838a9df13ec9 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051823 Aug 24 04:56:48.304494 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 469/996] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 24 04:56:48 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:48.375573 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:48.376302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:48.378703 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:48.379372 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:48.386389 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:48.386914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:48.387349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:48.388063 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:48.388858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:48.389309 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:48.421597 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:56:48.519738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-adfa5f8b-7c70-4188-8410-267d51e10c01 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 204 len: 0 microversion: 2.20 time: 0.147732 Aug 24 04:56:48.520637 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 528/997] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 24 04:56:48 2022] DELETE /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 04:56:48.529853 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:48.530510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:48.537023 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:48.538223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:48.538934 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:48.539885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:48.540357 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:48.540791 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:48.720122 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:48.730204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:48.731715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:48.732947 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8f8ec386-f1f7-457e-a501-ceb74d2c3ef4 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.207850 Aug 24 04:56:48.733448 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 470/998] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:48 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:49.764954 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:49.766275 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:49.776618 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:49.777220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:49.777754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:49.778582 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:49.779127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:49.779653 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:50.036858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:50.050141 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:50.052242 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:50.054596 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2cc46350-7fa4-4583-80c0-ac78b7af913b tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1723 microversion: 2.20 time: 0.298896 Aug 24 04:56:50.055511 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 529/999] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:49 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:56:51.080698 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:51.083025 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:51.091870 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:51.092952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:51.093639 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:51.094850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:51.095841 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:51.096429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:51.234981 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:51.246209 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-12586ef4-6654-49a4-86d5-16aeceb27472 req-1a058122-6a1c-423f-a747-b3ad0ca91107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25850e86-d01f-489f-b7be-a04e7854041b", "name": "network-vif-deleted", "tag": "c95760a7-3a19-4223-bc23-f813a2768a06"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:51.260271 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:51.264171 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c5112136c7947e3ac99949d330ba0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02571d09157b409a8bd4737acd07c5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:51.265431 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-481dfeda-2c21-4ec3-949c-599affa9fbb8 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 200 len: 1655 microversion: 2.20 time: 0.191338 Aug 24 04:56:51.271348 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 471/1000] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:51 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 1655 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:56:51.285709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-12586ef4-6654-49a4-86d5-16aeceb27472 req-1a058122-6a1c-423f-a747-b3ad0ca91107 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:51.286801 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-12586ef4-6654-49a4-86d5-16aeceb27472 req-1a058122-6a1c-423f-a747-b3ad0ca91107 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:51.287432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-12586ef4-6654-49a4-86d5-16aeceb27472 req-1a058122-6a1c-423f-a747-b3ad0ca91107 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:51.301476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-12586ef4-6654-49a4-86d5-16aeceb27472 req-1a058122-6a1c-423f-a747-b3ad0ca91107 service nova] Creating event network-vif-deleted:c95760a7-3a19-4223-bc23-f813a2768a06 for instance 25850e86-d01f-489f-b7be-a04e7854041b on hv-cinder-85426 Aug 24 04:56:51.307648 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-12586ef4-6654-49a4-86d5-16aeceb27472 req-1a058122-6a1c-423f-a747-b3ad0ca91107 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077264 Aug 24 04:56:51.308575 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 530/1001] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:56:52.294089 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:52.294723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:52.302940 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:52.304194 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:52.304719 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:52.306334 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:52.307195 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:52.308858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:52.327981 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] HTTP exception thrown: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Request method failure captured: Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b HTTP/1.1 Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa2-dv_RSTvS9FBpHzeP2CzRLbMD7v0dVmVxdh4x6CRpV_KFHKSGGgk2QjGl1m3hEuFmxUewyn49FrdYx40xz2fXvv_PwbYqy0m5ta9OaWHHUFdtjLVA5u7d-OXZog9CwkOX6GdZcJYoz5A9Sb07caa_T2UO5FKJryHSfaU_MK_rfWQ Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:56:52.329661 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_02571d09157b409a8bd4737acd07c5de"}]}] Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 7c5112136c7947e3ac99949d330ba0be Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:52.332175 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '25850e86-d01f-489f-b7be-a04e7854041b'} Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:52.333134 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:52.334989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:52.336745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Returning 404 to user: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:52.336745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9dd952c8-aa5c-43bd-81a4-42673a9790ab tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 404 len: 111 microversion: 2.20 time: 0.041945 Aug 24 04:56:52.336745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 472/1002] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:52 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:56:52.342783 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6c1e098c-cdf4-41e8-8181-25dcfc93ec76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '.version_select at 0x7fb0502be040>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:52.366797 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6c1e098c-cdf4-41e8-8181-25dcfc93ec76 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-621953616" status: 204 len: 0 microversion: 2.20 time: 0.028306 Aug 24 04:56:52.367390 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 531/1003] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Aug 24 04:56:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-621953616 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 04:56:54.365776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:54.367004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:54.374167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.374772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.375264 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:54.376062 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.376565 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.377037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:54.392932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] HTTP exception thrown: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Request method failure captured: Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: DELETE /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b HTTP/1.1 Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa2-dv_RSTvS9FBpHzeP2CzRLbMD7v0dVmVxdh4x6CRpV_KFHKSGGgk2QjGl1m3hEuFmxUewyn49FrdYx40xz2fXvv_PwbYqy0m5ta9OaWHHUFdtjLVA5u7d-OXZog9CwkOX6GdZcJYoz5A9Sb07caa_T2UO5FKJryHSfaU_MK_rfWQ Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:56:54.394576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_02571d09157b409a8bd4737acd07c5de"}]}] Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 7c5112136c7947e3ac99949d330ba0be Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.399859 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '25850e86-d01f-489f-b7be-a04e7854041b'} Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:54.401683 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.404027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.406266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Returning 404 to user: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:54.406266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-12de53c3-ac08-4a95-ac5f-722810c95133 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 404 len: 111 microversion: 2.20 time: 0.034558 Aug 24 04:56:54.406266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 473/1004] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 24 04:56:54 2022] DELETE /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:56:54.413234 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:54.414673 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 25850e86-d01f-489f-b7be-a04e7854041b] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:54.427296 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.428245 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.429184 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:54.430562 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.431443 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.432248 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:54.456776 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] HTTP exception thrown: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Request method failure captured: Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b HTTP/1.1 Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa2-dv_RSTvS9FBpHzeP2CzRLbMD7v0dVmVxdh4x6CRpV_KFHKSGGgk2QjGl1m3hEuFmxUewyn49FrdYx40xz2fXvv_PwbYqy0m5ta9OaWHHUFdtjLVA5u7d-OXZog9CwkOX6GdZcJYoz5A9Sb07caa_T2UO5FKJryHSfaU_MK_rfWQ Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:56:54.460651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_02571d09157b409a8bd4737acd07c5de"}]}] Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 7c5112136c7947e3ac99949d330ba0be Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.463410 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '25850e86-d01f-489f-b7be-a04e7854041b'} Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:54.464619 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. Aug 24 04:56:54.466671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:54.468814 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Returning 404 to user: Instance 25850e86-d01f-489f-b7be-a04e7854041b could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:54.468814 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f8ab70de-36c8-4ff9-94f8-e7e7de83cc67 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b" status: 404 len: 111 microversion: 2.20 time: 0.058781 Aug 24 04:56:54.468814 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 532/1005] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:54 2022] GET /compute/v2.1/servers/25850e86-d01f-489f-b7be-a04e7854041b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:56:55.639009 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:55.639866 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:55.648560 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:55.649124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:55.649631 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:55.650531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:55.651031 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:55.651544 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:55.669664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] HTTP exception thrown: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Request method failure captured: Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: DELETE /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 HTTP/1.1 Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa2-dv_RSTvS9FBpHzeP2CzRLbMD7v0dVmVxdh4x6CRpV_KFHKSGGgk2QjGl1m3hEuFmxUewyn49FrdYx40xz2fXvv_PwbYqy0m5ta9OaWHHUFdtjLVA5u7d-OXZog9CwkOX6GdZcJYoz5A9Sb07caa_T2UO5FKJryHSfaU_MK_rfWQ Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:56:55.671293 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_02571d09157b409a8bd4737acd07c5de"}]}] Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 7c5112136c7947e3ac99949d330ba0be Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.673723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '5eeaea49-9c15-4e0a-a446-98d3191293c8'} Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:55.674928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.677161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.679986 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Returning 404 to user: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:55.679986 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-41787725-e401-479f-9b04-2a24ee8f3d44 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 404 len: 111 microversion: 2.20 time: 0.037853 Aug 24 04:56:55.679986 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 474/1006] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 24 04:56:55 2022] DELETE /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:56:55.683635 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:55.684282 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] [instance: 5eeaea49-9c15-4e0a-a446-98d3191293c8] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:55.691200 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:55.691692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:55.692130 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:55.692844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:55.693297 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:55.693917 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:55.713263 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] HTTP exception thrown: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Request method failure captured: Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 HTTP/1.1 Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa2-dv_RSTvS9FBpHzeP2CzRLbMD7v0dVmVxdh4x6CRpV_KFHKSGGgk2QjGl1m3hEuFmxUewyn49FrdYx40xz2fXvv_PwbYqy0m5ta9OaWHHUFdtjLVA5u7d-OXZog9CwkOX6GdZcJYoz5A9Sb07caa_T2UO5FKJryHSfaU_MK_rfWQ Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:56:55.714910 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02571d09157b409a8bd4737acd07c5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_02571d09157b409a8bd4737acd07c5de"}]}] Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 02571d09157b409a8bd4737acd07c5de Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606227218 Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 7c5112136c7947e3ac99949d330ba0be Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606227218-project Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.717851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '5eeaea49-9c15-4e0a-a446-98d3191293c8'} Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:55.720056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. Aug 24 04:56:55.722709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:56:55.725825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] Returning 404 to user: Instance 5eeaea49-9c15-4e0a-a446-98d3191293c8 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:55.725825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d5092567-2358-4bdd-a78c-5cd585f10087 tempest-AttachVolumeShelveTestJSON-606227218 tempest-AttachVolumeShelveTestJSON-606227218-project] 10.222.0.60 "GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8" status: 404 len: 111 microversion: 2.20 time: 0.038016 Aug 24 04:56:55.725825 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 533/1007] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 24 04:56:55 2022] GET /compute/v2.1/servers/5eeaea49-9c15-4e0a-a446-98d3191293c8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:57:01.859527 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1011793505", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "networks": [{"uuid": "100b39aa-4616-4205-bb3d-9305e3e9eb0a"}]}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:01.934850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] validate_networks() for [('100b39aa-4616-4205-bb3d-9305e3e9eb0a', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:57:02.471584 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:57:02.472303 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:57:02.472895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:57:02.473408 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:57:02.473928 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:57:02.485599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.486773 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.486873 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.487731 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.488094 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.488474 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.507802 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Getting quotas for project 59d061c142de4a759ac7883fc098323c. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:57:02.512511 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Getting quotas for user 640b2b38f41744b4b4a33dc787e8bf56 and project 59d061c142de4a759ac7883fc098323c. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:57:02.526502 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:57:02.528917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:57:02.593582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d571e724-b341-4626-aa10-568a1e511413 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738369 Aug 24 04:57:02.595337 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 475/1008] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:57:02.612528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-663c0e89-9987-4b5d-843b-cea095d3240b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:02.613887 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-663c0e89-9987-4b5d-843b-cea095d3240b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:02.705565 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-663c0e89-9987-4b5d-843b-cea095d3240b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:02.713645 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-663c0e89-9987-4b5d-843b-cea095d3240b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1214 microversion: 2.1 time: 0.110166 Aug 24 04:57:02.714318 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 534/1009] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:02 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:03.751489 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:03.752800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:03.764989 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:03.765865 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:03.766558 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:03.767852 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:03.768316 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:03.768932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:03.860225 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:03.872513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c0105503-671f-4117-ae5d-5d54cf30a6a8 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1274 microversion: 2.1 time: 0.128415 Aug 24 04:57:03.873123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 476/1010] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:03 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:04.896418 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:04.897353 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:04.909809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:04.909809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:04.909809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:04.909809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:04.910558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:04.911415 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:05.192999 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:05.205846 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-f37c486b-db34-48b7-928a-09a15cdc948f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1314 microversion: 2.1 time: 0.314363 Aug 24 04:57:05.211436 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 535/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:04 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:05.670946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-96608639-433d-4220-a716-bc49da696868 req-e1b61512-3704-4db2-9263-70ece69c0e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb36344-83a0-4b22-86aa-09691e288204", "tag": "67979cef-4603-43f1-b869-531c7b9091f0"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:05.688088 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-96608639-433d-4220-a716-bc49da696868 req-e1b61512-3704-4db2-9263-70ece69c0e94 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:05.689754 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-96608639-433d-4220-a716-bc49da696868 req-e1b61512-3704-4db2-9263-70ece69c0e94 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:05.689919 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-96608639-433d-4220-a716-bc49da696868 req-e1b61512-3704-4db2-9263-70ece69c0e94 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:05.706344 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-96608639-433d-4220-a716-bc49da696868 req-e1b61512-3704-4db2-9263-70ece69c0e94 service nova] Creating event network-changed:67979cef-4603-43f1-b869-531c7b9091f0 for instance 4fb36344-83a0-4b22-86aa-09691e288204 on hv-cinder-85426 Aug 24 04:57:05.712997 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-96608639-433d-4220-a716-bc49da696868 req-e1b61512-3704-4db2-9263-70ece69c0e94 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049214 Aug 24 04:57:05.713751 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 477/1012] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:06.234384 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:06.235007 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:06.242493 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:06.242994 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:06.243430 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:06.244139 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:06.244797 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:06.245387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:06.442357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:06.451495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-eb167f64-7fef-4dae-b57e-16be88e57be0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1314 microversion: 2.1 time: 0.220803 Aug 24 04:57:06.452001 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 536/1013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:06 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:07.474030 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:07.477438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:07.485108 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:07.485602 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:07.486075 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:07.487014 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:07.487471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:07.487899 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:07.640210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:07.651947 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-31e393d8-5004-4e8e-ad1f-d7d3ae4b02b0 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1314 microversion: 2.1 time: 0.182764 Aug 24 04:57:07.652538 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 478/1014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:07 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:08.693234 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:08.693921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:08.700569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.701153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.701635 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.702440 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.702893 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.703312 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.872781 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:08.883375 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-084c701e-1223-4586-b4bc-8bb0875c11eb tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1314 microversion: 2.1 time: 0.201918 Aug 24 04:57:08.883995 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 537/1015] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:08 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:09.907528 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:09.907528 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:09.916253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:09.917083 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:09.918214 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:09.919310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:09.919845 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:09.920336 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:10.087037 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:10.095952 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-df89eb08-4659-496f-b81f-67d46e62462a tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1314 microversion: 2.1 time: 0.193608 Aug 24 04:57:10.096537 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 479/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:09 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:11.118056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:11.118805 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:11.125511 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:11.125880 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:11.126354 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:11.127057 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:11.127513 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:11.127945 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:11.291547 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:11.305220 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ca1b950d-c7ca-4e23-9546-b8a73362cf87 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1314 microversion: 2.1 time: 0.191265 Aug 24 04:57:11.306049 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 538/1017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:11 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:11.949896 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-a4af3d57-3ef8-4960-b645-a4572b5c0194 req-f6dbaa46-1272-4f03-b13b-96a26b525acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb36344-83a0-4b22-86aa-09691e288204", "name": "network-vif-plugged", "status": "completed", "tag": "67979cef-4603-43f1-b869-531c7b9091f0"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:11.962531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-a4af3d57-3ef8-4960-b645-a4572b5c0194 req-f6dbaa46-1272-4f03-b13b-96a26b525acc service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:11.963093 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-a4af3d57-3ef8-4960-b645-a4572b5c0194 req-f6dbaa46-1272-4f03-b13b-96a26b525acc service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:11.963525 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-a4af3d57-3ef8-4960-b645-a4572b5c0194 req-f6dbaa46-1272-4f03-b13b-96a26b525acc service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:11.979448 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-a4af3d57-3ef8-4960-b645-a4572b5c0194 req-f6dbaa46-1272-4f03-b13b-96a26b525acc service nova] Creating event network-vif-plugged:67979cef-4603-43f1-b869-531c7b9091f0 for instance 4fb36344-83a0-4b22-86aa-09691e288204 on hv-cinder-85426 Aug 24 04:57:11.989100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-a4af3d57-3ef8-4960-b645-a4572b5c0194 req-f6dbaa46-1272-4f03-b13b-96a26b525acc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040419 Aug 24 04:57:11.989100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 480/1018] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:12.327486 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:12.328109 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:12.336037 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:12.336584 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:12.337040 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:12.337795 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:12.338294 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:12.338727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:12.497751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:12.512673 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-186690fc-fd86-4b86-95d0-e010d694e5a9 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1314 microversion: 2.1 time: 0.188925 Aug 24 04:57:12.513759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 539/1019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:12 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:13.533339 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:13.534290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=6 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:13.541604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:13.542417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:13.551750 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:13.552355 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:13.553629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:13.554747 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:13.555209 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:13.555833 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:13.713688 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:13.723706 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-73404179-50a7-4113-a89d-8a7720fc523f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1314 microversion: 2.1 time: 0.191263 Aug 24 04:57:13.725550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 481/1020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:13 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:14.746948 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:14.747915 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:14.752663 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:14.755470 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:14.756293 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:14.757892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:14.758639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:14.759104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:14.759566 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:14.910752 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:14.919254 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-215b6266-41e4-40b3-af5b-50e6e16611ef tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1498 microversion: 2.1 time: 0.176319 Aug 24 04:57:14.919826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 540/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:14 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:15.338725 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:15.339327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:15.346021 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:15.346515 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:15.347142 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:15.347929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:15.348289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:15.348714 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:15.377197 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Going to try to terminate instance {{(pid=127416) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:57:15.465750 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-38679e82-3e60-492e-83bd-c10124156f39 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 204 len: 0 microversion: 2.1 time: 0.131409 Aug 24 04:57:15.467414 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 482/1022] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:57:15 2022] DELETE /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:57:15.476763 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:15.477392 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:15.483949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:15.484570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:15.484957 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:15.485884 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:15.486324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:15.486748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:15.630763 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:15.639978 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d3d35835-fdba-45b9-b656-a58592f6f820 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1504 microversion: 2.1 time: 0.167930 Aug 24 04:57:15.640568 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 541/1023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:15 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:16.667103 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:16.667966 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:16.674538 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:16.675047 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:16.675467 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:16.676212 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:16.676630 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:16.677048 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:16.832778 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:16.841028 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f9e82bc5-f68d-4a67-a7d8-988bff4b9c02 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1504 microversion: 2.1 time: 0.179778 Aug 24 04:57:16.841604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 483/1024] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:16 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:17.390084 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-1633915e-a986-4734-849f-52d7f37b6f39 req-af541206-929d-4d5f-829f-9e3424e585c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb36344-83a0-4b22-86aa-09691e288204", "name": "network-vif-deleted", "tag": "67979cef-4603-43f1-b869-531c7b9091f0"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:17.405000 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-1633915e-a986-4734-849f-52d7f37b6f39 req-af541206-929d-4d5f-829f-9e3424e585c7 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:17.405490 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-1633915e-a986-4734-849f-52d7f37b6f39 req-af541206-929d-4d5f-829f-9e3424e585c7 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:17.405921 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-1633915e-a986-4734-849f-52d7f37b6f39 req-af541206-929d-4d5f-829f-9e3424e585c7 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:17.422131 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-1633915e-a986-4734-849f-52d7f37b6f39 req-af541206-929d-4d5f-829f-9e3424e585c7 service nova] Creating event network-vif-deleted:67979cef-4603-43f1-b869-531c7b9091f0 for instance 4fb36344-83a0-4b22-86aa-09691e288204 on hv-cinder-85426 Aug 24 04:57:17.429522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-1633915e-a986-4734-849f-52d7f37b6f39 req-af541206-929d-4d5f-829f-9e3424e585c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042442 Aug 24 04:57:17.430172 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 542/1025] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:17.863266 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:17.863876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:17.871907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:17.872405 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:17.872885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:17.873555 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:17.874048 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:17.874492 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:17.910603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:17.911087 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:17.911523 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:17.911982 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lazy-loading 'fault' on Instance uuid 4fb36344-83a0-4b22-86aa-09691e288204 {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:17.957364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:17.965493 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-47a192e6-028c-4f13-bc7b-d73f50254192 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 200 len: 1304 microversion: 2.1 time: 0.106125 Aug 24 04:57:17.966144 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 484/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:17 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:18.987765 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:18.988444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 4fb36344-83a0-4b22-86aa-09691e288204] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:18.990600 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:18.997137 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:18.997623 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:18.998087 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:18.998847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:18.999330 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:18.999773 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:19.004036 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:19.018651 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] HTTP exception thrown: Instance 4fb36344-83a0-4b22-86aa-09691e288204 could not be found. Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Request method failure captured: Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 HTTP/1.1 Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa-bwzkYahaFVbUzikk5smkajtLLMLbBPnzTGu3VfeRKF_vjVuqOi2gqVnTSJ5lYTy964prXOj0q9q_GBlGKSqBZVokp008Ya30xfaIs0UBUbIM58NMGkcTJ-VDqgsYQTCHnhuMzsrtxnfh8cH08n0PX4wFSj6MJ-T0CEbWektSazW0 Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 59d061c142de4a759ac7883fc098323c Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-VolumesActionsTest-1115423811 Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:57:19.020308 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59d061c142de4a759ac7883fc098323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/59d061c142de4a759ac7883fc098323c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59d061c142de4a759ac7883fc098323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_59d061c142de4a759ac7883fc098323c"}]}] Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-VolumesActionsTest-1115423811 Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 59d061c142de4a759ac7883fc098323c Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-VolumesActionsTest-1115423811 Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-VolumesActionsTest-1115423811-project Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 640b2b38f41744b4b4a33dc787e8bf56 Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-VolumesActionsTest-1115423811-project Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 4fb36344-83a0-4b22-86aa-09691e288204 could not be found. Aug 24 04:57:19.021751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '4fb36344-83a0-4b22-86aa-09691e288204'} Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb36344-83a0-4b22-86aa-09691e288204 could not be found. Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:57:19.023127 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb36344-83a0-4b22-86aa-09691e288204 could not be found. Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb36344-83a0-4b22-86aa-09691e288204 could not be found. Aug 24 04:57:19.024751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:57:19.026351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Returning 404 to user: Instance 4fb36344-83a0-4b22-86aa-09691e288204 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:57:19.026351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-811afcbc-ce3f-4418-b794-13baab75682f tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204" status: 404 len: 111 microversion: 2.1 time: 0.038240 Aug 24 04:57:19.026351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 543/1027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:18 2022] GET /compute/v2.1/servers/4fb36344-83a0-4b22-86aa-09691e288204 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:57:19.131311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1097223238", "imageRef": "387dd802-6ad5-47e6-a671-a2a166d1ab3a", "flavorRef": "452", "networks": [{"uuid": "100b39aa-4616-4205-bb3d-9305e3e9eb0a"}]}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:19.139985 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:19.190772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] validate_networks() for [('100b39aa-4616-4205-bb3d-9305e3e9eb0a', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:57:19.824804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:57:19.825238 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:57:19.825709 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:57:19.826162 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:57:19.826625 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:57:19.835972 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:19.836640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:19.837078 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:19.837804 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:19.838582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:19.839220 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:19.846964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:19.860772 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Getting quotas for project 59d061c142de4a759ac7883fc098323c. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:57:19.865454 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Getting quotas for user 640b2b38f41744b4b4a33dc787e8bf56 and project 59d061c142de4a759ac7883fc098323c. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:57:19.880706 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:57:19.883102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='387dd802-6ad5-47e6-a671-a2a166d1ab3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:57:19.935008 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d8e3616a-f97d-4828-bc17-cc1943f9bf31 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807475 Aug 24 04:57:19.935651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 485/1028] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:57:19.946959 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5ab481b1-e052-4a07-875c-9c09967a8bd4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:19.947827 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5ab481b1-e052-4a07-875c-9c09967a8bd4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:20.012771 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5ab481b1-e052-4a07-875c-9c09967a8bd4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:20.021120 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5ab481b1-e052-4a07-875c-9c09967a8bd4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1214 microversion: 2.1 time: 0.078279 Aug 24 04:57:20.021716 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 544/1029] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:19 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:21.043444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:21.044125 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:21.051277 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:21.051774 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:21.052213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:21.052919 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:21.053587 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:21.054033 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:21.136647 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:21.144884 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e61a1a22-5157-4799-aa8f-f21b78a36c17 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1272 microversion: 2.1 time: 0.105974 Aug 24 04:57:21.145673 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 486/1030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:21 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:22.167000 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:22.167725 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:22.175795 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:22.176298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:22.176738 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:22.177461 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:22.177914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:22.178384 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:22.218968 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-6c01fb82-5193-4aaf-af1c-a115991d12c7 req-faa802a9-fdd0-4d59-8214-cd92e224ea09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d7451d4-7244-4395-b199-d90b7a9ecd2c", "tag": "a0dae62f-e3d5-4096-ab24-9af855554c0b"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:22.236253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-6c01fb82-5193-4aaf-af1c-a115991d12c7 req-faa802a9-fdd0-4d59-8214-cd92e224ea09 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:22.237849 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-6c01fb82-5193-4aaf-af1c-a115991d12c7 req-faa802a9-fdd0-4d59-8214-cd92e224ea09 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:22.238739 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-6c01fb82-5193-4aaf-af1c-a115991d12c7 req-faa802a9-fdd0-4d59-8214-cd92e224ea09 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:22.253034 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-6c01fb82-5193-4aaf-af1c-a115991d12c7 req-faa802a9-fdd0-4d59-8214-cd92e224ea09 service nova] Creating event network-changed:a0dae62f-e3d5-4096-ab24-9af855554c0b for instance 9d7451d4-7244-4395-b199-d90b7a9ecd2c on hv-cinder-85426 Aug 24 04:57:22.259473 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-6c01fb82-5193-4aaf-af1c-a115991d12c7 req-faa802a9-fdd0-4d59-8214-cd92e224ea09 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044304 Aug 24 04:57:22.260383 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 487/1031] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:57:22.487165 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:22.497170 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3ed4adf3-fb59-4da6-8180-8a33c0e6825c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.334818 Aug 24 04:57:22.504016 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 545/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:22 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:23.519658 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:23.520352 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:23.528419 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:23.528915 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:23.529362 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:23.530104 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:23.530568 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:23.530988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:23.666970 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:23.675453 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-5bb84624-0f1b-41ec-86c9-2940906d1fbc tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.160271 Aug 24 04:57:23.676084 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 488/1033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:23 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:24.698283 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:24.698810 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:24.705292 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:24.705792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:24.706250 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:24.706935 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:24.707387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:24.707808 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:24.859200 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:24.867639 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d87d2cf0-85c7-409e-99c4-1d245ee3bbea tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.173371 Aug 24 04:57:24.868904 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 546/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:24 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:25.889548 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:25.890223 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:25.897032 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:25.897508 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:25.897936 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:25.898694 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:25.899139 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:25.899555 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:26.036646 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:26.045014 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-17ef49cd-5283-4b3b-b577-df548f6fcef5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.159397 Aug 24 04:57:26.045569 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 489/1035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:25 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:27.068530 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:27.069878 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:27.079134 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:27.079794 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:27.080416 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:27.081264 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:27.081933 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:27.082601 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:27.238183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:27.247192 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-571b966e-6f60-4062-a6d8-e3ed376e9142 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.183988 Aug 24 04:57:27.247913 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 547/1036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:27 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:28.268873 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:28.269512 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:28.277071 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:28.277848 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:28.278315 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:28.279012 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:28.279471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:28.279895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:28.413821 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:28.422101 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-d4d6d6d8-672d-4cd4-85fa-6fa188e72166 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.157338 Aug 24 04:57:28.422660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 490/1037] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:28 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:29.442892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:29.443449 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:29.450405 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:29.450901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:29.451343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:29.452041 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:29.452495 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:29.452920 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:29.581983 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:29.590329 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-7b6610a6-0fc3-42e5-bd64-d1e4ff98ae08 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.151468 Aug 24 04:57:29.590888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 548/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:29 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:30.528887 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-574240270", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1170355751", "security_groups": [{"name": "tempest-secgroup-smoke-1341339893"}], "block_device_mapping_v2": [{"uuid": "bc70052a-1dab-45f4-a498-654b54061a6e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e2fdcab-491d-4305-ac60-290a289ebd7f"}]}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:30.539713 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:30.540397 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=6 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:30.611828 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:30.612460 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:30.614324 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:30.620657 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:30.621142 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:30.621569 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:30.622298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:30.622748 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:30.623171 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:30.646562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.network.neutron [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] validate_networks() for [('2e2fdcab-491d-4305-ac60-290a289ebd7f', None, None, None, None, None)] {{(pid=127416) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:57:30.854428 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:30.862860 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0d449925-2f35-427f-82af-d0d86a05d296 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.254761 Aug 24 04:57:30.863537 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 549/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:30 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:31.093850 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Flavor limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:57:31.094290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Image limits 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:57:31.094761 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Flavor pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:57:31.095164 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Image pref 0:0:0 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:57:31.095572 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.virt.hardware [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:57:31.105435 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:31.105857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:31.106327 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:31.107050 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:31.107536 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:31.107954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:31.124658 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Getting quotas for project 003043b046cc4646a61fe4c27af47e67. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:57:31.128633 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Getting quotas for user 105c18e25e104cb6a7b100caa2a96f04 and project 003043b046cc4646a61fe4c27af47e67. Resources: {'ram', 'cores', 'instances'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:57:31.186398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Going to run 1 instances... {{(pid=127416) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:57:31.188601 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc70052a-1dab-45f4-a498-654b54061a6e',volume_size=None,volume_type=None)] {{(pid=127416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:57:31.321888 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9b085381-0446-4051-872b-8ce7920e729d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.796759 Aug 24 04:57:31.322587 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 491/1040] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:57:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:57:31.333394 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-230c6ed7-c536-45ee-b456-3655a905c7da tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:31.334016 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-230c6ed7-c536-45ee-b456-3655a905c7da tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:31.389211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-230c6ed7-c536-45ee-b456-3655a905c7da tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:31.396520 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-230c6ed7-c536-45ee-b456-3655a905c7da tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1094 microversion: 2.1 time: 0.067017 Aug 24 04:57:31.397056 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 550/1041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:31 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:31.887425 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:31.888372 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:31.903826 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:31.904491 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:31.905070 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:31.905953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:31.906536 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:31.907039 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:31.998813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-6deca852-3564-4154-9add-5b607e7fdd4e req-867345fd-e43c-4c9c-b9cd-8d88ba459886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7451d4-7244-4395-b199-d90b7a9ecd2c", "name": "network-vif-plugged", "status": "completed", "tag": "a0dae62f-e3d5-4096-ab24-9af855554c0b"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:32.019429 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6deca852-3564-4154-9add-5b607e7fdd4e req-867345fd-e43c-4c9c-b9cd-8d88ba459886 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:32.020014 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6deca852-3564-4154-9add-5b607e7fdd4e req-867345fd-e43c-4c9c-b9cd-8d88ba459886 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:32.020555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-6deca852-3564-4154-9add-5b607e7fdd4e req-867345fd-e43c-4c9c-b9cd-8d88ba459886 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:32.033970 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-6deca852-3564-4154-9add-5b607e7fdd4e req-867345fd-e43c-4c9c-b9cd-8d88ba459886 service nova] Creating event network-vif-plugged:a0dae62f-e3d5-4096-ab24-9af855554c0b for instance 9d7451d4-7244-4395-b199-d90b7a9ecd2c on hv-cinder-85426 Aug 24 04:57:32.039503 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-6deca852-3564-4154-9add-5b607e7fdd4e req-867345fd-e43c-4c9c-b9cd-8d88ba459886 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044406 Aug 24 04:57:32.040209 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 551/1042] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:57:32.055916 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:32.063675 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f221fa13-93af-4095-b7c7-a6e67621bca3 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.183007 Aug 24 04:57:32.064321 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 492/1043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:31 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:32.419070 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:32.419760 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:32.426520 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:32.427003 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:32.427431 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:32.428125 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:32.428575 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:32.428989 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:32.498557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:32.506289 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-59e8907f-fd6c-4354-95cb-240f46545d62 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1210 microversion: 2.1 time: 0.092096 Aug 24 04:57:32.506854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 552/1044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:32 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:33.093086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:33.093086 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:33.095891 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:33.096498 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:33.097313 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:33.098165 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:33.098851 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:33.099537 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:33.392906 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:33.403487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a7d812e6-7484-466e-8a8e-a69a7f4dc3e5 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1314 microversion: 2.1 time: 0.322144 Aug 24 04:57:33.404079 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 493/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:33 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:33.528002 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:33.528629 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:33.535282 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:33.535772 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:33.536211 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:33.536934 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:33.537396 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:33.537821 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:33.671472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:33.679227 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ca31413c-9a08-46d2-a88d-2475ac916ea4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.156203 Aug 24 04:57:33.680558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 553/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:33 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:34.426964 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:34.428674 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:34.434323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-5f25c713-e723-44f8-b10f-dd7c6cddbd48 req-10b95427-3748-480d-83ce-0fc2b8035097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf28703-7a3f-4b17-9bf5-2870a79c7c87", "tag": "596e259e-4fb6-44de-92b7-6a475320ab6e"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:34.440895 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:34.441953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:34.442864 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:34.444210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:34.444770 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-5f25c713-e723-44f8-b10f-dd7c6cddbd48 req-10b95427-3748-480d-83ce-0fc2b8035097 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:34.445356 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-5f25c713-e723-44f8-b10f-dd7c6cddbd48 req-10b95427-3748-480d-83ce-0fc2b8035097 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:34.446175 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-5f25c713-e723-44f8-b10f-dd7c6cddbd48 req-10b95427-3748-480d-83ce-0fc2b8035097 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:34.447252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:34.447809 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:34.460526 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-5f25c713-e723-44f8-b10f-dd7c6cddbd48 req-10b95427-3748-480d-83ce-0fc2b8035097 service nova] Creating event network-changed:596e259e-4fb6-44de-92b7-6a475320ab6e for instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 on hv-cinder-85426 Aug 24 04:57:34.466424 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-5f25c713-e723-44f8-b10f-dd7c6cddbd48 req-10b95427-3748-480d-83ce-0fc2b8035097 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037073 Aug 24 04:57:34.467860 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 554/1047] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:57:34.698768 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:34.701480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:34.702356 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:34.708632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:34.709132 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:34.709283 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-485b72e8-d99d-4ede-ac46-fb92e5408c74 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1498 microversion: 2.1 time: 0.287805 Aug 24 04:57:34.709567 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:34.710311 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:34.710454 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 494/1048] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:34 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1498 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:34.711309 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:34.711795 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:34.985441 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:34.995372 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c93cf404-886b-42e1-b56f-ef33374078b4 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.298532 Aug 24 04:57:35.010895 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 555/1049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:34 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:35.285152 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:35.285675 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:35.294289 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:35.294811 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:35.295263 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:35.295976 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:35.296434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:35.296865 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:35.333381 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Going to try to terminate instance {{(pid=127416) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:57:35.448411 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-848d5388-d09d-4d32-99d4-d4a7e6899fad tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 204 len: 0 microversion: 2.1 time: 0.167327 Aug 24 04:57:35.449140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 495/1050] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:57:35 2022] DELETE /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:57:35.464615 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:35.465230 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:35.475505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:35.475996 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:35.477038 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:35.477747 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:35.478233 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:35.478785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:35.643521 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:35.655570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6d5178dc-3ded-42d7-92a8-69b0a1b367a6 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1504 microversion: 2.1 time: 0.196379 Aug 24 04:57:35.657402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 556/1051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:35 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:36.021426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:36.022173 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:36.028977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:36.029456 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:36.029891 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:36.030617 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:36.031068 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:36.031492 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:36.424427 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:36.434198 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-15aac522-badd-4b25-aac2-d92a9f035773 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.417112 Aug 24 04:57:36.434786 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 496/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:36 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:36.681820 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:36.682425 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:36.688951 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:36.689444 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:36.689878 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:36.690614 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:36.691070 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:36.691497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:36.933416 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:36.941386 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2f0f7db2-dbf3-4ad4-bfd2-72bbbae2352b tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1504 microversion: 2.1 time: 0.264853 Aug 24 04:57:36.941991 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 557/1053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:36 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:37.455388 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:37.455995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:37.463801 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:37.464727 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:37.465146 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:37.465885 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:37.466392 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:37.466792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:37.656917 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:37.667723 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-19344e0d-f92e-49aa-8503-20cca30f2cd6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.216393 Aug 24 04:57:37.669766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 497/1054] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:37 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:37.685448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-89cddbf8-ad2e-4643-b60f-9aa78f42cbf7 req-f0d3d8b4-eab1-4af9-9013-35392923b84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7451d4-7244-4395-b199-d90b7a9ecd2c", "name": "network-vif-deleted", "tag": "a0dae62f-e3d5-4096-ab24-9af855554c0b"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:37.698538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-89cddbf8-ad2e-4643-b60f-9aa78f42cbf7 req-f0d3d8b4-eab1-4af9-9013-35392923b84e service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:37.699029 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-89cddbf8-ad2e-4643-b60f-9aa78f42cbf7 req-f0d3d8b4-eab1-4af9-9013-35392923b84e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:37.699480 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-89cddbf8-ad2e-4643-b60f-9aa78f42cbf7 req-f0d3d8b4-eab1-4af9-9013-35392923b84e service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:37.713901 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-89cddbf8-ad2e-4643-b60f-9aa78f42cbf7 req-f0d3d8b4-eab1-4af9-9013-35392923b84e service nova] Creating event network-vif-deleted:a0dae62f-e3d5-4096-ab24-9af855554c0b for instance 9d7451d4-7244-4395-b199-d90b7a9ecd2c on hv-cinder-85426 Aug 24 04:57:37.720429 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-89cddbf8-ad2e-4643-b60f-9aa78f42cbf7 req-f0d3d8b4-eab1-4af9-9013-35392923b84e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040794 Aug 24 04:57:37.721313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 558/1055] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:37.964632 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:37.965244 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:37.971481 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:37.971918 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:37.972348 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:37.973052 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:37.973507 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:37.973932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:38.026137 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:38.026622 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:38.027060 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:38.027514 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lazy-loading 'fault' on Instance uuid 9d7451d4-7244-4395-b199-d90b7a9ecd2c {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:38.070810 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:38.078726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f3e98fce-54d4-4d5a-82b6-778c1e8d6f48 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1304 microversion: 2.1 time: 0.118393 Aug 24 04:57:38.079300 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 498/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:37 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:38.691604 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:38.692302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:38.698923 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:38.699411 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:38.699847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:38.700532 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:38.700987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:38.701419 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:38.838873 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:38.846793 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e2853380-c711-4b7f-8bc9-c0ff55e6f1f6 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.159428 Aug 24 04:57:38.847351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 559/1057] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:38 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:39.101123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:39.101857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:39.108656 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:39.109148 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:39.109594 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:39.110319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:39.110774 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:39.111200 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:39.146902 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:39.147380 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:39.147823 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:39.148301 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lazy-loading 'fault' on Instance uuid 9d7451d4-7244-4395-b199-d90b7a9ecd2c {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:39.189837 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:39.198364 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-3aeb70b2-efa8-4101-b924-7f024dfbea9c tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1304 microversion: 2.1 time: 0.101403 Aug 24 04:57:39.198929 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 499/1058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:39 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:39.867941 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:39.868669 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:39.875245 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:39.875730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:39.876170 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:39.876866 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:39.877328 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:39.877754 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:40.017455 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:40.026924 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-02d46d8f-4878-4518-9388-43c9ce070009 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.163523 Aug 24 04:57:40.027515 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 560/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:39 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:40.219416 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:40.219996 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:40.228003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:40.228909 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:40.229424 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:40.230176 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:40.230638 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:40.231063 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:40.265692 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:40.266204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:40.266638 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:40.267343 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lazy-loading 'fault' on Instance uuid 9d7451d4-7244-4395-b199-d90b7a9ecd2c {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:40.311123 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:40.319247 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-972df17c-7581-4b3c-b04e-5cbb3313d8f4 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1304 microversion: 2.1 time: 0.103744 Aug 24 04:57:40.319833 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 500/1060] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:40 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:41.047805 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:41.048423 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:41.056782 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:41.057275 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:41.057719 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:41.058476 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:41.058938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:41.059368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:41.214943 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:41.227278 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6e74c49a-305b-43c6-b097-ec527d64078f tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.182435 Aug 24 04:57:41.227941 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 561/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:41 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:41.341085 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:41.341827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:41.343780 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:41.344651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=6 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:41.352646 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:41.353142 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:41.353585 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:41.354329 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:41.354792 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:41.355217 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:41.362197 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:41.393686 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:41.394279 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:41.394653 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:41.395111 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lazy-loading 'fault' on Instance uuid 9d7451d4-7244-4395-b199-d90b7a9ecd2c {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:41.442219 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640b2b38f41744b4b4a33dc787e8bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d061c142de4a759ac7883fc098323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:41.449785 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2bb64c2b-069c-4722-9a7a-f01ee189c11d tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 200 len: 1304 microversion: 2.1 time: 0.112583 Aug 24 04:57:41.450398 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 501/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:41 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:42.248666 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:42.249276 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:42.252260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:42.256642 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:42.257135 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:42.258301 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:42.259529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:42.260087 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:42.260422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:42.401478 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:42.409473 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-30747b0e-b5ec-426e-85ea-145fda10d90e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.164675 Aug 24 04:57:42.410057 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 562/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:42 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:42.471184 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:42.471923 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] [instance: 9d7451d4-7244-4395-b199-d90b7a9ecd2c] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:42.479167 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:42.479652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:42.480190 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:42.480971 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:42.481421 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:42.481849 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:42.495560 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] HTTP exception thrown: Instance 9d7451d4-7244-4395-b199-d90b7a9ecd2c could not be found. Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Request method failure captured: Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c HTTP/1.1 Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa-bwzkYahaFVbUzikk5smkajtLLMLbBPnzTGu3VfeRKF_vjVuqOi2gqVnTSJ5lYTy964prXOj0q9q_GBlGKSqBZVokp008Ya30xfaIs0UBUbIM58NMGkcTJ-VDqgsYQTCHnhuMzsrtxnfh8cH08n0PX4wFSj6MJ-T0CEbWektSazW0 Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 59d061c142de4a759ac7883fc098323c Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-VolumesActionsTest-1115423811 Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:57:42.497208 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59d061c142de4a759ac7883fc098323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/59d061c142de4a759ac7883fc098323c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59d061c142de4a759ac7883fc098323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_59d061c142de4a759ac7883fc098323c"}]}] Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-VolumesActionsTest-1115423811 Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 59d061c142de4a759ac7883fc098323c Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-VolumesActionsTest-1115423811 Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-VolumesActionsTest-1115423811-project Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 640b2b38f41744b4b4a33dc787e8bf56 Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-VolumesActionsTest-1115423811-project Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 9d7451d4-7244-4395-b199-d90b7a9ecd2c could not be found. Aug 24 04:57:42.499470 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '9d7451d4-7244-4395-b199-d90b7a9ecd2c'} Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d7451d4-7244-4395-b199-d90b7a9ecd2c could not be found. Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:57:42.500875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d7451d4-7244-4395-b199-d90b7a9ecd2c could not be found. Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d7451d4-7244-4395-b199-d90b7a9ecd2c could not be found. Aug 24 04:57:42.503487 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:57:42.506475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] Returning 404 to user: Instance 9d7451d4-7244-4395-b199-d90b7a9ecd2c could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:57:42.506475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8ce2c0bc-cb7d-4d97-8ea4-17e3f5ce6b11 tempest-VolumesActionsTest-1115423811 tempest-VolumesActionsTest-1115423811-project] 10.222.0.60 "GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c" status: 404 len: 111 microversion: 2.1 time: 0.031689 Aug 24 04:57:42.506475 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 502/1064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:42 2022] GET /compute/v2.1/servers/9d7451d4-7244-4395-b199-d90b7a9ecd2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:57:43.430690 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:43.431323 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:43.438601 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:43.439126 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:43.439564 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:43.440341 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:43.441136 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:43.441610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:43.592873 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:43.602320 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9285a3bc-d7d5-4f65-a1ee-270f63000c4d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.175709 Aug 24 04:57:43.602926 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 563/1065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:43 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:44.625027 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:44.625950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:44.633427 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:44.634140 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:44.634504 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:44.635221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:44.635674 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:44.636105 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:44.788753 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:44.798944 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-22ec4736-5437-4830-8682-62427a55358d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.177023 Aug 24 04:57:44.799776 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 503/1066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:44 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:45.819544 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:45.820313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:45.827244 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:45.827735 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:45.828179 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:45.828890 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:45.829349 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:45.829775 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:45.845603 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=100 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:45.971989 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:45.980368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-daa99126-eaaf-4323-a9cd-629594e61b47 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.164669 Aug 24 04:57:45.980938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 564/1067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:45 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:47.002340 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:47.003486 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:47.015908 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:47.016770 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:47.017816 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:47.019132 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:47.019986 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:47.020694 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:47.194916 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:47.203946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-2d272b5c-ae9f-4a1f-a1e1-2feec46a1bc5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.206192 Aug 24 04:57:47.217273 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 504/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:46 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:48.225556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:48.227505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:48.239387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:48.240524 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:48.244077 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:48.247397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:48.248128 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:48.248800 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:48.314872 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-4f756940-f9cd-4818-968e-c774cf9c7f5a req-c8a5df7c-13e1-49ad-9bbe-ab73c2bc0b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf28703-7a3f-4b17-9bf5-2870a79c7c87", "name": "network-vif-plugged", "status": "completed", "tag": "596e259e-4fb6-44de-92b7-6a475320ab6e"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:48.333903 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-4f756940-f9cd-4818-968e-c774cf9c7f5a req-c8a5df7c-13e1-49ad-9bbe-ab73c2bc0b17 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:48.335204 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-4f756940-f9cd-4818-968e-c774cf9c7f5a req-c8a5df7c-13e1-49ad-9bbe-ab73c2bc0b17 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:48.336444 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-4f756940-f9cd-4818-968e-c774cf9c7f5a req-c8a5df7c-13e1-49ad-9bbe-ab73c2bc0b17 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:48.350436 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-4f756940-f9cd-4818-968e-c774cf9c7f5a req-c8a5df7c-13e1-49ad-9bbe-ab73c2bc0b17 service nova] Creating event network-vif-plugged:596e259e-4fb6-44de-92b7-6a475320ab6e for instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 on hv-cinder-85426 Aug 24 04:57:48.357715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-4f756940-f9cd-4818-968e-c774cf9c7f5a req-c8a5df7c-13e1-49ad-9bbe-ab73c2bc0b17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047287 Aug 24 04:57:48.359078 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 505/1069] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:48.532340 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:48.542216 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-08351293-d2f3-4adc-9252-2254df8a369e tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.320997 Aug 24 04:57:48.557986 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 565/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:48 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:49.565412 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:49.566269 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:49.568907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:49.576131 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:49.576941 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:49.577555 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:49.578210 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:49.578583 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:49.579014 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:49.741469 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:49.752376 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1c2162f3-f5dc-44b9-85ae-9c4febe548bf tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1266 microversion: 2.1 time: 0.191826 Aug 24 04:57:49.763369 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 506/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:49 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:50.775692 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:50.777061 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:50.780785 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=50 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:50.784538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:50.785291 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:50.785732 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:50.786458 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:50.786916 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:50.787341 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:50.956432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:50.965183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c5c33449-1851-4158-8a28-9053a3a5e11d tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1453 microversion: 2.1 time: 0.194395 Aug 24 04:57:50.978627 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 566/1072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:50 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:50.986252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:50.986790 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:50.994828 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:50.995601 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:50.996234 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:50.997133 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:50.997782 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:50.998734 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:51.168083 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:51.181544 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-876f7c7e-360a-46e3-a03d-ff754c4f1443 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1453 microversion: 2.1 time: 0.198969 Aug 24 04:57:51.182228 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 507/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:50 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:53.137802 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-3dd0c22e-6e6b-4e95-a6ae-3e098b67cec4 req-1d88d670-62c0-437d-81ca-95c8c275ef52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf28703-7a3f-4b17-9bf5-2870a79c7c87", "tag": "596e259e-4fb6-44de-92b7-6a475320ab6e"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:53.150878 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-3dd0c22e-6e6b-4e95-a6ae-3e098b67cec4 req-1d88d670-62c0-437d-81ca-95c8c275ef52 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:53.151514 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-3dd0c22e-6e6b-4e95-a6ae-3e098b67cec4 req-1d88d670-62c0-437d-81ca-95c8c275ef52 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:53.151949 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-3dd0c22e-6e6b-4e95-a6ae-3e098b67cec4 req-1d88d670-62c0-437d-81ca-95c8c275ef52 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:53.170616 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-3dd0c22e-6e6b-4e95-a6ae-3e098b67cec4 req-1d88d670-62c0-437d-81ca-95c8c275ef52 service nova] Creating event network-changed:596e259e-4fb6-44de-92b7-6a475320ab6e for instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 on hv-cinder-85426 Aug 24 04:57:53.177282 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-3dd0c22e-6e6b-4e95-a6ae-3e098b67cec4 req-1d88d670-62c0-437d-81ca-95c8c275ef52 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043336 Aug 24 04:57:53.178648 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 567/1074] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:04.198121 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:59:04.198684 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Wed Aug 24 04:59:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:59:09.778353 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:59:09.778937 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Wed Aug 24 04:59:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:59:15.948650 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=3 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:15.949489 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=35 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:16.265074 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e17c3e89-627d-4b8f-a463-86d160c7cfb2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Action: 'create', calling method: .version_select at 0x7fb0509b0820>, body: {"keypair": {"name": "tempest-TestShelveInstance-411025658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWxK+l77P80P3XshSBcqtIMt/0+5tCfU/7i0BwbaZU+/VWNOhEK33xkwWxAVeWf7mORxs7Wd8U/U61knjjEzGE7Zk06ITl+j8Qz7c6y0rmIw6Oy/K5RnUIbtRd0+ReywQ=="}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:16.283439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-e17c3e89-627d-4b8f-a463-86d160c7cfb2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Getting quotas for project e654f48e605347759229022c81f7d39e. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:16.288530 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.quota [None req-e17c3e89-627d-4b8f-a463-86d160c7cfb2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Getting quotas for user c10a21129e1e419c8ea52d4066c02f36 and project e654f48e605347759229022c81f7d39e. Resources: {'key_pairs'} {{(pid=127416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:16.326401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e17c3e89-627d-4b8f-a463-86d160c7cfb2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.378715 Aug 24 04:59:16.328449 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 508/1075] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 24 04:59:15 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:25.478204 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:59:25.478755 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Wed Aug 24 04:59:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:59:31.998896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=3 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:31.999663 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=17 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:32.004703 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1764085766", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-411025658", "security_groups": [{"name": "tempest-secgroup-smoke-1525085274"}], "networks": [{"uuid": "2a6d6096-eda5-4a34-b464-c35b53d41fff"}], "block_device_mapping_v2": [{"uuid": "b583270d-127d-4937-b4f5-e1011dc22a2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:32.241850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.network.neutron [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] validate_networks() for [('2a6d6096-eda5-4a34-b464-c35b53d41fff', None, None, None, None, None)] {{(pid=127415) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:59:32.758101 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Flavor limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:59:32.758527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Image limits 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:59:32.759000 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Flavor pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:59:32.759406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Image pref 0:0:0 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:59:32.759822 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.virt.hardware [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:59:32.769078 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:32.769501 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:32.770074 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:32.770745 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:32.771193 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:32.771612 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:32.789377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Getting quotas for project e654f48e605347759229022c81f7d39e. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:32.793377 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.quota [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Getting quotas for user c10a21129e1e419c8ea52d4066c02f36 and project e654f48e605347759229022c81f7d39e. Resources: {'ram', 'cores', 'instances'} {{(pid=127415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:32.856107 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Going to run 1 instances... {{(pid=127415) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:59:32.858613 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b583270d-127d-4937-b4f5-e1011dc22a2b',volume_size=None,volume_type=None)] {{(pid=127415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:59:32.997201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-26efc474-3129-4560-b9ee-169561a80968 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.000169 Aug 24 04:59:32.997823 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 568/1076] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 24 04:59:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:59:33.006998 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=4 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:33.008710 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:33.014434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f54f24e4-cab7-4ad9-812f-083391255b04 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:33.015227 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f54f24e4-cab7-4ad9-812f-083391255b04 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:33.125252 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f54f24e4-cab7-4ad9-812f-083391255b04 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:33.132855 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f54f24e4-cab7-4ad9-812f-083391255b04 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1088 microversion: 2.1 time: 0.128181 Aug 24 04:59:33.133429 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 509/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:33 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1088 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:34.159160 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:34.160489 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:34.175185 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:34.175858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:34.176602 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:34.177395 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:34.177903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:34.178485 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:34.248374 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:34.256558 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9fbf4e07-f75d-4501-83d0-534fbdecd61e tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1204 microversion: 2.1 time: 0.105625 Aug 24 04:59:34.257853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 569/1078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:34 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1204 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:35.283907 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:35.285083 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:35.296855 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:35.297666 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:35.298430 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:35.299651 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:35.300445 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:35.301185 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:35.460055 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:35.469253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e4a012bf-72f1-436b-96a1-c1640a20f627 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.192972 Aug 24 04:59:35.469991 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 510/1079] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:35 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:35.941143 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-da71c2b0-875f-42e8-8427-92bf3de9f2aa req-d9b7eba4-f682-48ec-aa5c-d73e2e37eeaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c85d840-de5a-4fbc-8b0a-51319cf3fcaa", "tag": "30b575ee-1bf1-44ee-bff6-9db0cee23b07"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:35.951813 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-da71c2b0-875f-42e8-8427-92bf3de9f2aa req-d9b7eba4-f682-48ec-aa5c-d73e2e37eeaf service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:35.952298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-da71c2b0-875f-42e8-8427-92bf3de9f2aa req-d9b7eba4-f682-48ec-aa5c-d73e2e37eeaf service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:35.952735 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-da71c2b0-875f-42e8-8427-92bf3de9f2aa req-d9b7eba4-f682-48ec-aa5c-d73e2e37eeaf service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:35.965505 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-da71c2b0-875f-42e8-8427-92bf3de9f2aa req-d9b7eba4-f682-48ec-aa5c-d73e2e37eeaf service nova] Creating event network-changed:30b575ee-1bf1-44ee-bff6-9db0cee23b07 for instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa on hv-cinder-85426 Aug 24 04:59:35.970826 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-da71c2b0-875f-42e8-8427-92bf3de9f2aa req-d9b7eba4-f682-48ec-aa5c-d73e2e37eeaf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034163 Aug 24 04:59:35.971441 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 570/1080] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:36.500361 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:36.500930 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:36.508010 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:36.508494 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:36.508932 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:36.509625 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:36.510116 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:36.510604 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:36.650674 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:36.658836 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9594d5cc-ab51-48d4-b43e-b607154e5050 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.162429 Aug 24 04:59:36.659399 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 511/1081] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:36 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:37.683502 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:37.684241 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:37.690695 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:37.691180 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:37.691618 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:37.692307 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:37.692760 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:37.693177 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:37.829709 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:37.837693 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-903925a3-2df1-457d-8ac8-899935d9a8ef tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.159365 Aug 24 04:59:37.838286 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 571/1082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:37 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:38.858595 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:38.859277 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:38.865634 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:38.866212 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:38.866660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:38.867438 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:38.867890 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:38.868320 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:39.005311 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:39.013820 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-172d1782-c860-4be1-a0e1-f5fdf46649ee tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.159322 Aug 24 04:59:39.014423 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 512/1083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:38 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:40.035351 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:40.035962 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:40.042611 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:40.043097 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:40.043536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:40.044228 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:40.044686 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:40.045112 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:40.178950 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:40.187589 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-fb670cf1-15cf-4dc4-a4ae-7a36dd725bd9 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.156091 Aug 24 04:59:40.188157 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 572/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:40 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:41.209936 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:41.210563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:41.217705 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:41.218221 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:41.218660 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:41.219378 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:41.219854 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:41.220279 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:41.362358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:41.377126 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-cd40feb6-cbc3-4025-9cee-6b349cf890e3 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.171371 Aug 24 04:59:41.378892 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 513/1085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:41 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:42.401782 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:42.402499 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:42.409041 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:42.409529 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:42.409972 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:42.410688 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:42.411177 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:42.411605 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:42.549023 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:42.557434 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-317aacf2-1126-4901-8608-8dd097f998f7 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.160005 Aug 24 04:59:42.558036 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 573/1086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:42 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:43.578611 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:43.579380 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:43.581756 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell0:SELECT=2 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:43.587904 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:43.588394 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:43.588827 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:43.589562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:43.590038 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:43.590462 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:43.749003 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:43.756870 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e0fc59d6-3cc7-4787-a2ad-bcddb7786c9a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.182334 Aug 24 04:59:43.757563 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 514/1087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:43 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:44.779265 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:44.780271 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:44.782632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=2 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:44.783679 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell0:SELECT=6 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:44.793176 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.793847 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.794345 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.795162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.795898 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.796405 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.969001 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:44.986268 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ed437d0f-37ab-448c-8770-edde78f74617 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.210949 Aug 24 04:59:44.987519 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 574/1088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:44 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:45.681544 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:45.682103 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:45.684186 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-b5a8011c-b6f5-4b44-8b2b-f3fb7176378f req-50e029e9-33d7-421a-a522-83bbb6afdbb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf28703-7a3f-4b17-9bf5-2870a79c7c87", "tag": "596e259e-4fb6-44de-92b7-6a475320ab6e"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:45.688645 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.689434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.689871 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.690823 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.691360 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.691785 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.694158 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-b5a8011c-b6f5-4b44-8b2b-f3fb7176378f req-50e029e9-33d7-421a-a522-83bbb6afdbb3 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.694497 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-b5a8011c-b6f5-4b44-8b2b-f3fb7176378f req-50e029e9-33d7-421a-a522-83bbb6afdbb3 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.695654 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-b5a8011c-b6f5-4b44-8b2b-f3fb7176378f req-50e029e9-33d7-421a-a522-83bbb6afdbb3 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.709706 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-b5a8011c-b6f5-4b44-8b2b-f3fb7176378f req-50e029e9-33d7-421a-a522-83bbb6afdbb3 service nova] Creating event network-changed:596e259e-4fb6-44de-92b7-6a475320ab6e for instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 on hv-cinder-85426 Aug 24 04:59:45.716175 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-b5a8011c-b6f5-4b44-8b2b-f3fb7176378f req-50e029e9-33d7-421a-a522-83bbb6afdbb3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035943 Aug 24 04:59:45.717106 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 575/1089] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:59:45.722313 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Going to try to terminate instance {{(pid=127416) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:59:45.815764 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ea3f0710-f8c4-40fa-b3f8-80dd09dec460 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 204 len: 0 microversion: 2.1 time: 0.137237 Aug 24 04:59:45.817073 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 515/1090] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:59:45 2022] DELETE /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:59:45.829675 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:45.831222 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:45.839938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.840615 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.841302 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.842245 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.843090 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.843742 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.984583 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:45.993421 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-33564dd9-d28c-478e-a68f-2d36870f32ff tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1578 microversion: 2.1 time: 0.169888 Aug 24 04:59:45.994247 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 576/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:45 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:46.013749 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:46.014480 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:46.020953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:46.021431 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:46.021868 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:46.022582 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:46.023138 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:46.023562 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:46.178184 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:46.193517 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-4032f535-600f-42cf-8754-75e41a3e8c38 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.183426 Aug 24 04:59:46.194580 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 516/1092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:46 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:46.899381 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [req-f014b805-0b89-4029-a39b-0a9e5caeeeda req-bbd36093-9ce6-4361-ab63-77ca4072ebcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c85d840-de5a-4fbc-8b0a-51319cf3fcaa", "name": "network-vif-plugged", "status": "completed", "tag": "30b575ee-1bf1-44ee-bff6-9db0cee23b07"}]} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:46.913183 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-f014b805-0b89-4029-a39b-0a9e5caeeeda req-bbd36093-9ce6-4361-ab63-77ca4072ebcd service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:46.914291 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-f014b805-0b89-4029-a39b-0a9e5caeeeda req-bbd36093-9ce6-4361-ab63-77ca4072ebcd service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:46.914759 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [req-f014b805-0b89-4029-a39b-0a9e5caeeeda req-bbd36093-9ce6-4361-ab63-77ca4072ebcd service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:46.926556 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.compute.server_external_events [req-f014b805-0b89-4029-a39b-0a9e5caeeeda req-bbd36093-9ce6-4361-ab63-77ca4072ebcd service nova] Creating event network-vif-plugged:30b575ee-1bf1-44ee-bff6-9db0cee23b07 for instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa on hv-cinder-85426 Aug 24 04:59:46.931570 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [req-f014b805-0b89-4029-a39b-0a9e5caeeeda req-bbd36093-9ce6-4361-ab63-77ca4072ebcd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036447 Aug 24 04:59:46.932728 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 577/1093] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:47.014437 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:47.015053 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:47.021822 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.022436 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.022979 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:47.024554 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.025023 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.025453 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:47.173310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:47.182980 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-1aabc0ab-456d-44ef-a7de-2229359d50f1 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1578 microversion: 2.1 time: 0.172323 Aug 24 04:59:47.183610 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 517/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:47 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:47.217696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:47.218516 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:47.225226 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.225743 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.226621 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:47.227337 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.227792 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.228214 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:47.440144 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:47.456588 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-2f1e3b96-2e1e-4f6c-b0cd-e4653e789e8b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.242681 Aug 24 04:59:47.457722 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 578/1095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:47 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:59:48.172481 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-4eee28e6-5c95-4c07-b9e8-095437ceb86f req-2d2e826b-c451-402f-92aa-2737c4541613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf28703-7a3f-4b17-9bf5-2870a79c7c87", "name": "network-vif-deleted", "tag": "596e259e-4fb6-44de-92b7-6a475320ab6e"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:48.183555 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-4eee28e6-5c95-4c07-b9e8-095437ceb86f req-2d2e826b-c451-402f-92aa-2737c4541613 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.184212 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-4eee28e6-5c95-4c07-b9e8-095437ceb86f req-2d2e826b-c451-402f-92aa-2737c4541613 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.184726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-4eee28e6-5c95-4c07-b9e8-095437ceb86f req-2d2e826b-c451-402f-92aa-2737c4541613 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.200977 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-4eee28e6-5c95-4c07-b9e8-095437ceb86f req-2d2e826b-c451-402f-92aa-2737c4541613 service nova] Creating event network-vif-deleted:596e259e-4fb6-44de-92b7-6a475320ab6e for instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 on hv-cinder-85426 Aug 24 04:59:48.206229 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-4eee28e6-5c95-4c07-b9e8-095437ceb86f req-2d2e826b-c451-402f-92aa-2737c4541613 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103038 Aug 24 04:59:48.206810 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 518/1096] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:48.207190 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:48.208024 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:48.216093 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.216599 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.217046 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.217779 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.218288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.218719 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.310298 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:48.318610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-9b704132-12ec-4b41-8be2-1e519a2bbc70 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 200 len: 1225 microversion: 2.1 time: 0.115956 Aug 24 04:59:48.319204 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 579/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:48 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:48.479640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:48.480433 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:48.487171 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.487745 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.488245 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.489041 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.489539 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.490079 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.649029 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:48.658458 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8337ce6f-3e69-4e16-a2d1-6732d58ad8ba tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1260 microversion: 2.1 time: 0.183191 Aug 24 04:59:48.659006 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 519/1098] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:48 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:49.341051 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:49.341719 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fcf28703-7a3f-4b17-9bf5-2870a79c7c87] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:49.348739 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.349225 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.349659 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.350387 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.350871 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.351292 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.366025 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] HTTP exception thrown: Instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 could not be found. Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Request method failure captured: Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 HTTP/1.1 Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa5Agym_ab4WHdHqaA1mveq8VGe7F_JQrxNXkJSRB8DXEkhMk4Smb_fK9HTwbWATdh89iDdcVpWKHKWHx7lrnXVdtSfewoJV7n3L9tE5hrrHbPcZ18Qp_kmkZGotRzV7tl8w5hjYA68dQfMchBCDSIek-vs3XyfWhngD50CvKI1g-OE Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:59:49.367843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_003043b046cc4646a61fe4c27af47e67"}]}] Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 105c18e25e104cb6a7b100caa2a96f04 Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 could not be found. Aug 24 04:59:49.370466 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': 'fcf28703-7a3f-4b17-9bf5-2870a79c7c87'} Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 could not be found. Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:59:49.372162 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 could not be found. Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 could not be found. Aug 24 04:59:49.375060 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:49.377599 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Returning 404 to user: Instance fcf28703-7a3f-4b17-9bf5-2870a79c7c87 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:59:49.377599 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-0a0494a6-6399-47e9-bd9e-92c2d0d62eb8 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87" status: 404 len: 111 microversion: 2.1 time: 0.032067 Aug 24 04:59:49.377599 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 580/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:49 2022] GET /compute/v2.1/servers/fcf28703-7a3f-4b17-9bf5-2870a79c7c87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:49.693906 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:49.694695 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:49.702315 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.702875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.703248 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.703959 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.704422 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.704852 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.852551 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:49.861949 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-f001f813-4f59-46a0-a0e4-f678cc3d2ff0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1443 microversion: 2.1 time: 0.173597 Aug 24 04:59:49.862576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 520/1100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:49 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1443 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:49.883514 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:49.884378 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:49.890538 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.891025 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.891464 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.892169 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.892885 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.893315 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.071737 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:50.080201 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-3d1eeb73-7ac2-4fdc-b03a-a002f1e53247 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1443 microversion: 2.1 time: 0.201360 Aug 24 04:59:50.080787 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 581/1101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:49 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1443 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:52.164824 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-e356ac8a-ec5c-46f4-ae43-a183ed189022 req-1bcff807-ff9b-4c30-b84b-611ef8c219e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c85d840-de5a-4fbc-8b0a-51319cf3fcaa", "tag": "30b575ee-1bf1-44ee-bff6-9db0cee23b07"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:52.182414 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-e356ac8a-ec5c-46f4-ae43-a183ed189022 req-1bcff807-ff9b-4c30-b84b-611ef8c219e3 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.183222 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-e356ac8a-ec5c-46f4-ae43-a183ed189022 req-1bcff807-ff9b-4c30-b84b-611ef8c219e3 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.183837 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-e356ac8a-ec5c-46f4-ae43-a183ed189022 req-1bcff807-ff9b-4c30-b84b-611ef8c219e3 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.196720 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-e356ac8a-ec5c-46f4-ae43-a183ed189022 req-1bcff807-ff9b-4c30-b84b-611ef8c219e3 service nova] Creating event network-changed:30b575ee-1bf1-44ee-bff6-9db0cee23b07 for instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa on hv-cinder-85426 Aug 24 04:59:52.202724 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-e356ac8a-ec5c-46f4-ae43-a183ed189022 req-1bcff807-ff9b-4c30-b84b-611ef8c219e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045388 Aug 24 04:59:52.203520 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 521/1102] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:52.677736 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:52.679746 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:52.705803 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.715130 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.716309 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.719075 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.721000 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.722516 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.756602 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-525ae6d8-b44f-405c-a49b-f06eb9c2e511 req-29de13d6-5dc4-4c28-8bfc-33ab07f3773c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa50707e-0efd-4a9e-be1c-b2abfc2b1160", "tag": "7a40828b-ec56-4289-bf85-8dd64624ce3f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:52.772259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:59:52.773782 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-525ae6d8-b44f-405c-a49b-f06eb9c2e511 req-29de13d6-5dc4-4c28-8bfc-33ab07f3773c service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.774292 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-525ae6d8-b44f-405c-a49b-f06eb9c2e511 req-29de13d6-5dc4-4c28-8bfc-33ab07f3773c service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.774721 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-525ae6d8-b44f-405c-a49b-f06eb9c2e511 req-29de13d6-5dc4-4c28-8bfc-33ab07f3773c service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.796441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-525ae6d8-b44f-405c-a49b-f06eb9c2e511 req-29de13d6-5dc4-4c28-8bfc-33ab07f3773c service nova] Creating event network-changed:7a40828b-ec56-4289-bf85-8dd64624ce3f for instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 on hv-cinder-85426 Aug 24 04:59:52.811348 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-525ae6d8-b44f-405c-a49b-f06eb9c2e511 req-29de13d6-5dc4-4c28-8bfc-33ab07f3773c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136634 Aug 24 04:59:52.811833 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 522/1103] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:59:52.890894 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-fb9a0f22-5fa4-4086-aa57-9eee96630a15 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 204 len: 0 microversion: 2.1 time: 0.221080 Aug 24 04:59:52.892015 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 582/1104] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:59:52 2022] DELETE /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:59:52.907706 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:52.908640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:52.918333 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.919214 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.919988 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.920881 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.921499 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.922286 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:53.085184 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:53.094803 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a3f00a10-37ed-412d-b631-e613fd2e39f9 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1578 microversion: 2.1 time: 0.195799 Aug 24 04:59:53.095688 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 523/1105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:52 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:54.119632 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:54.120317 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:54.126977 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.127472 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.127903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:54.128610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.129065 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.129489 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:54.276671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:54.287368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5f2d83d6-baa4-4f78-9f7d-0eba5fc23ac5 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1578 microversion: 2.1 time: 0.173843 Aug 24 04:59:54.288102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 583/1106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:54 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:55.064780 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-03eab21d-d31a-4f7a-9d56-d544a18846cf req-1d245f1b-2c2c-4ed4-b05a-12e5c9539b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa50707e-0efd-4a9e-be1c-b2abfc2b1160", "name": "network-vif-deleted", "tag": "7a40828b-ec56-4289-bf85-8dd64624ce3f"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:55.076308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-03eab21d-d31a-4f7a-9d56-d544a18846cf req-1d245f1b-2c2c-4ed4-b05a-12e5c9539b34 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.076795 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-03eab21d-d31a-4f7a-9d56-d544a18846cf req-1d245f1b-2c2c-4ed4-b05a-12e5c9539b34 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.077235 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-03eab21d-d31a-4f7a-9d56-d544a18846cf req-1d245f1b-2c2c-4ed4-b05a-12e5c9539b34 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.090583 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-03eab21d-d31a-4f7a-9d56-d544a18846cf req-1d245f1b-2c2c-4ed4-b05a-12e5c9539b34 service nova] Creating event network-vif-deleted:7a40828b-ec56-4289-bf85-8dd64624ce3f for instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 on hv-cinder-85426 Aug 24 04:59:55.095818 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-03eab21d-d31a-4f7a-9d56-d544a18846cf req-1d245f1b-2c2c-4ed4-b05a-12e5c9539b34 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Aug 24 04:59:55.096423 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 524/1107] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:55.311103 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:55.311723 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:55.318368 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.318859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.319295 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.321379 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.321843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.322361 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.395399 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c18e25e104cb6a7b100caa2a96f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003043b046cc4646a61fe4c27af47e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:55.404617 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-c6555e6a-3b47-4c25-97ee-02e570d060db tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 200 len: 1225 microversion: 2.1 time: 0.098462 Aug 24 04:59:55.405403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 584/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:55 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:56.427396 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:56.428083 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: fa50707e-0efd-4a9e-be1c-b2abfc2b1160] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:56.435875 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.436360 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.436802 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.437505 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.437965 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.438434 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.453021 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] HTTP exception thrown: Instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 could not be found. Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Request method failure captured: Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 HTTP/1.1 Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa5Agym_ab4WHdHqaA1mveq8VGe7F_JQrxNXkJSRB8DXEkhMk4Smb_fK9HTwbWATdh89iDdcVpWKHKWHx7lrnXVdtSfewoJV7n3L9tE5hrrHbPcZ18Qp_kmkZGotRzV7tl8w5hjYA68dQfMchBCDSIek-vs3XyfWhngD50CvKI1g-OE Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:59:56.454715 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_003043b046cc4646a61fe4c27af47e67"}]}] Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 105c18e25e104cb6a7b100caa2a96f04 Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 could not be found. Aug 24 04:59:56.456510 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': 'fa50707e-0efd-4a9e-be1c-b2abfc2b1160'} Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 could not be found. Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:59:56.457403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 could not be found. Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 could not be found. Aug 24 04:59:56.458987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.460446 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Returning 404 to user: Instance fa50707e-0efd-4a9e-be1c-b2abfc2b1160 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:59:56.460446 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-82c0a488-4b19-4764-91a2-6bca4b43ae04 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160" status: 404 len: 111 microversion: 2.1 time: 0.033497 Aug 24 04:59:56.460446 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 525/1109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:56 2022] GET /compute/v2.1/servers/fa50707e-0efd-4a9e-be1c-b2abfc2b1160 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:59:56.918691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:56.919229 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:56.925802 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.926527 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.927066 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.927843 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.928301 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.928741 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.954258 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.wsgi [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] HTTP exception thrown: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Request method failure captured: Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: request: DELETE /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 HTTP/1.1 Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept: application/json Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Accept-Encoding: identity Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Connection: close Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Length: 0 Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Content-Type: application/json Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Host: 10.222.0.60 Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Openstack-System-Scope: None Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: User-Agent: python-urllib3/1.26.11 Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Auth-Token: gAAAAABjBa5Agym_ab4WHdHqaA1mveq8VGe7F_JQrxNXkJSRB8DXEkhMk4Smb_fK9HTwbWATdh89iDdcVpWKHKWHx7lrnXVdtSfewoJV7n3L9tE5hrrHbPcZ18Qp_kmkZGotRzV7tl8w5hjYA68dQfMchBCDSIek-vs3XyfWhngD50CvKI1g-OE Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Id: None Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Domain-Name: None Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Identity-Status: Confirmed Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Is-Admin-Project: True Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Id: default Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Domain-Name: Default Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Project-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Role: reader,member Aug 24 04:59:56.955892 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Roles: reader,member Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_003043b046cc4646a61fe4c27af47e67"}]}] Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-Tenant-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Id: default Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Domain-Name: Default Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Id: 105c18e25e104cb6a7b100caa2a96f04 Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: X-User-Name: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: method: > Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: exception: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:56.958462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: action_args: {'id': '57311393-dc24-4693-a167-bafcb80a8c46'} Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:59:56.959990 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:56.963153 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR nova.api.openstack.wsgi Aug 24 04:59:56.965448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Returning 404 to user: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. {{(pid=127415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:59:56.965448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-8324eb2c-b913-4b96-a706-e21bb81fb098 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "DELETE /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 404 len: 111 microversion: 2.1 time: 0.042553 Aug 24 04:59:56.965448 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 585/1110] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 04:59:56 2022] DELETE /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:56.970339 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:56.971555 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] [instance: 57311393-dc24-4693-a167-bafcb80a8c46] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:56.983102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.983974 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.984741 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.985948 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.986783 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.987526 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:57.014396 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] HTTP exception thrown: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Request method failure captured: Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 HTTP/1.1 Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBa5Agym_ab4WHdHqaA1mveq8VGe7F_JQrxNXkJSRB8DXEkhMk4Smb_fK9HTwbWATdh89iDdcVpWKHKWHx7lrnXVdtSfewoJV7n3L9tE5hrrHbPcZ18Qp_kmkZGotRzV7tl8w5hjYA68dQfMchBCDSIek-vs3XyfWhngD50CvKI1g-OE Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 04:59:57.016950 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/003043b046cc4646a61fe4c27af47e67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_003043b046cc4646a61fe4c27af47e67"}]}] Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: 003043b046cc4646a61fe4c27af47e67 Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-TestVolumeBootPattern-492767301 Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: 105c18e25e104cb6a7b100caa2a96f04 Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-TestVolumeBootPattern-492767301-project Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:57.019857 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '57311393-dc24-4693-a167-bafcb80a8c46'} Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:59:57.021319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. Aug 24 04:59:57.024550 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 04:59:57.025953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Returning 404 to user: Instance 57311393-dc24-4693-a167-bafcb80a8c46 could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:59:57.025953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-16c7973a-ef0f-40fb-97e2-22f12f7750e3 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46" status: 404 len: 111 microversion: 2.1 time: 0.055685 Aug 24 04:59:57.025953 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 526/1111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:56 2022] GET /compute/v2.1/servers/57311393-dc24-4693-a167-bafcb80a8c46 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:58.343344 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-6aa1ee48-fb3c-425b-99d8-139085de8e13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] Calling method '.version_select at 0x7fb050041430>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:58.367859 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-6aa1ee48-fb3c-425b-99d8-139085de8e13 tempest-TestVolumeBootPattern-492767301 tempest-TestVolumeBootPattern-492767301-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1170355751" status: 202 len: 0 microversion: 2.1 time: 0.027739 Aug 24 04:59:58.368442 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 586/1112] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Aug 24 04:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1170355751 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:00:36.765310 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:00:36.765946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Wed Aug 24 05:00:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:01:47.861891 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:47.862662 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:47.867020 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:47.867549 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:47.875746 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:47.876358 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:47.876795 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:47.877484 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:47.877937 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:47.878390 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:47.902780 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.objects.instance [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lazy-loading 'flavor' on Instance uuid 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa {{(pid=127416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:01:47.973975 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-c05c3fdd-2806-45e9-ae4b-86c56cd7e000 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "POST /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa/action" status: 202 len: 0 microversion: 2.1 time: 0.113562 Aug 24 05:01:47.974576 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 527/1113] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 05:01:47 2022] POST /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:01:47.980751 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6e4b156-d93f-4b21-be51-1dd38f08b39e] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:01:47.981313 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:47.982106 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:47.987578 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:47.991653 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:48.000134 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:48.000761 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:48.001206 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:48.001958 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:48.002498 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:48.002933 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:48.143809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:48.151678 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-11e298b8-dec8-4964-95f7-8d94069fc679 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.172779 Aug 24 05:01:48.152231 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 587/1114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:47 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:49.174681 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:49.175415 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:49.182255 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:49.182741 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:49.183179 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:49.184756 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:49.185230 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:49.185655 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:49.316290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:49.324186 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9607292e-af7e-48e8-a3ea-7628e4fb17df tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.153996 Aug 24 05:01:49.325137 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 528/1115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:49 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:50.345851 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:50.346560 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:50.354407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:50.354896 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:50.355388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:50.356130 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:50.356617 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:50.357047 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:50.362568 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6e4b156-d93f-4b21-be51-1dd38f08b39e] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 42916. Aug 24 05:01:50.489062 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:50.497252 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-5bd41cec-9d19-49c9-8180-53e61d9f1b94 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.155287 Aug 24 05:01:50.497803 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 588/1116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:50 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:51.519246 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:51.519858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:51.526075 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:51.526558 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:51.526995 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:51.528643 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:51.529137 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:51.529569 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:51.674934 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:51.684120 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-0d48130f-ac6a-4974-a9f5-47f3dbe0610f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.168791 Aug 24 05:01:51.685439 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 529/1117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:51 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:52.706855 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:52.707397 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:52.713749 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:52.714260 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:52.714693 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:52.715380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:52.716402 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:52.716866 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:52.848853 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:52.857110 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-e0cf2c3f-0a7a-4816-bec4-ed2716cb8bd2 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.154182 Aug 24 05:01:52.857690 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 589/1118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:52 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:53.878802 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:53.879403 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:53.885815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:53.886317 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:53.886746 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:53.887471 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:53.888004 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:53.888425 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:54.027240 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:54.039382 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-e0b1cf85-8580-4503-abad-0691511f729f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.164309 Aug 24 05:01:54.040122 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 530/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:53 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:55.062403 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:55.063006 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:55.069711 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:55.070237 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:55.070679 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:55.071384 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:55.071844 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:55.072269 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:55.211259 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:55.219946 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-96190bcd-9c58-48b8-b4c1-db77fc37f4fd tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.162717 Aug 24 05:01:55.220528 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 590/1120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:55 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:56.241784 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:56.242417 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:56.249353 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:56.249847 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:56.250308 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:56.251016 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:56.251473 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:56.251987 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:56.396540 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:56.406973 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-ca16cdbe-b95e-43a9-8f85-062aa85d926d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.168937 Aug 24 05:01:56.407554 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 531/1121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:56 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:57.429121 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:57.429770 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:57.437147 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:57.437654 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:57.438115 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:57.438800 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:57.439254 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:57.439677 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:57.847197 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:57.855705 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-dcc0a5cb-b38b-4f7d-942c-034caf3d0605 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.430588 Aug 24 05:01:57.856292 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 591/1122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:57 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:58.876806 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:58.877533 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:58.884954 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.885449 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.885900 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.886693 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.887154 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.888102 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:59.027261 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:59.036164 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a59e3f49-d4f8-45f9-b034-4a63284198f6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.163624 Aug 24 05:01:59.037513 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 532/1123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:58 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:00.058552 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:00.059811 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:00.066490 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:00.066975 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:00.067406 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:00.068101 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:00.068555 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:00.068974 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:00.205967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:00.213911 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-cbfb5957-dc68-4b59-b820-3d9a4c89dc54 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.159192 Aug 24 05:02:00.214536 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 592/1124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:00 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:01.235255 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:01.235840 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:01.242548 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.243065 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.243531 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.244217 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.244671 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.245084 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.380279 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:01.389155 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-428fe4a9-c69a-4e8d-b747-08504d84f5f0 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1569 microversion: 2.1 time: 0.157923 Aug 24 05:02:01.389731 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 533/1125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:01 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:01.410604 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:01.411200 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:01.417722 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.418246 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.418730 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.419364 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.420249 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.420249 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.455494 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127415) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:02:01.526357 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-a9eb633e-75c4-45da-b0be-454e4bd2d28a tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "POST /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa/action" status: 202 len: 0 microversion: 2.1 time: 0.119628 Aug 24 05:02:01.526967 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 593/1126] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 24 05:02:01 2022] POST /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:02:01.535018 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:01.535618 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:01.548624 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.549151 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.550182 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.551232 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.551731 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.552330 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.703016 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:01.711640 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-9009adf8-2c13-423e-a79c-b9cabe2cd29d tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1517 microversion: 2.1 time: 0.180275 Aug 24 05:02:01.712506 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 534/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:01 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:02.735704 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:02.736301 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:02.742380 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:02.742968 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:02.743432 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:02.744108 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:02.744561 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:02.744987 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:02.889319 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:02.897507 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-b82ec227-a70c-462e-b4bc-ca8e590bceda tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1519 microversion: 2.1 time: 0.166593 Aug 24 05:02:02.898107 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 594/1128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:02 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:03.920600 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:03.921168 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:03.927616 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:03.928090 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:03.928522 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:03.929213 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:03.929691 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:03.930142 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:04.060726 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:04.068565 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-442d20de-f86e-4dbb-b6f7-fe586ab87309 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1575 microversion: 2.1 time: 0.152558 Aug 24 05:02:04.069124 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 535/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:03 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:05.090104 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:05.090728 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:05.097084 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.097561 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.097992 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.098696 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.099143 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.099557 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.234125 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:05.241888 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-d58fc2cc-9d0e-45db-b2f3-7c7fca04b7a4 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1575 microversion: 2.1 time: 0.155696 Aug 24 05:02:05.242481 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 595/1130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:05 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:05.610522 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-7dd15e91-df63-4bdd-ae9e-553536479681 req-784ebeeb-49ae-447e-8e2c-6e8aa37c6ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c85d840-de5a-4fbc-8b0a-51319cf3fcaa", "name": "network-vif-unplugged", "status": "completed", "tag": "30b575ee-1bf1-44ee-bff6-9db0cee23b07"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:05.620139 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7dd15e91-df63-4bdd-ae9e-553536479681 req-784ebeeb-49ae-447e-8e2c-6e8aa37c6ab1 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.620629 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7dd15e91-df63-4bdd-ae9e-553536479681 req-784ebeeb-49ae-447e-8e2c-6e8aa37c6ab1 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.621085 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-7dd15e91-df63-4bdd-ae9e-553536479681 req-784ebeeb-49ae-447e-8e2c-6e8aa37c6ab1 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.634279 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-7dd15e91-df63-4bdd-ae9e-553536479681 req-784ebeeb-49ae-447e-8e2c-6e8aa37c6ab1 service nova] Creating event network-vif-unplugged:30b575ee-1bf1-44ee-bff6-9db0cee23b07 for instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa on hv-cinder-85426 Aug 24 05:02:05.640564 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-7dd15e91-df63-4bdd-ae9e-553536479681 req-784ebeeb-49ae-447e-8e2c-6e8aa37c6ab1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102199 Aug 24 05:02:05.641152 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 536/1131] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 05:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:02:06.263727 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:06.264691 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:06.271903 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:06.272388 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:06.272815 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:06.273511 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:06.273957 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:06.274395 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:06.403189 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:06.410986 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-1f8fc381-cc3c-4824-921f-a9dc5eaaa626 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1575 microversion: 2.1 time: 0.151824 Aug 24 05:02:06.411550 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 596/1132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:06 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:07.433349 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:07.434180 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:07.443871 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:07.444652 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:07.445094 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:07.445800 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:07.446313 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:07.446741 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:07.583381 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:07.591110 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-8acd3009-a41c-430c-a59e-18408a119138 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1575 microversion: 2.1 time: 0.162839 Aug 24 05:02:07.591769 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 537/1133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:07 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:08.612182 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:08.612809 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:08.619210 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:08.619679 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:08.620102 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:08.620777 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:08.621221 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:08.621640 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:08.761288 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:08.769938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-541a5d20-3105-490a-8f46-e386e59c6eea tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1575 microversion: 2.1 time: 0.161639 Aug 24 05:02:08.770531 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 597/1134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:08 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:09.791967 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:09.792570 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:09.800319 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:09.800820 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:09.801334 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:09.802147 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:09.802672 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:09.803205 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:09.968271 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:09.977791 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-72a58f83-d88f-44ce-b543-1627be4083b6 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1575 microversion: 2.1 time: 0.189723 Aug 24 05:02:09.978653 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 538/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:09 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:11.000610 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:11.001241 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:11.007998 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:11.008478 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:11.008914 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:11.009614 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:11.010096 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:11.010518 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:11.153733 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:11.163336 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-bb8ee6da-0096-4875-bedc-4137afd8f439 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1562 microversion: 2.1 time: 0.166598 Aug 24 05:02:11.163936 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 598/1136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:10 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:13.657209 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-d3a1b7b0-ae41-4f23-9b93-2196bedf6307 req-a8c7e53f-42b8-42bd-bae6-f0910b53ea9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c85d840-de5a-4fbc-8b0a-51319cf3fcaa", "name": "network-vif-plugged", "status": "completed", "tag": "30b575ee-1bf1-44ee-bff6-9db0cee23b07"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:13.671603 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-d3a1b7b0-ae41-4f23-9b93-2196bedf6307 req-a8c7e53f-42b8-42bd-bae6-f0910b53ea9f service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:13.672091 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-d3a1b7b0-ae41-4f23-9b93-2196bedf6307 req-a8c7e53f-42b8-42bd-bae6-f0910b53ea9f service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:13.672527 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-d3a1b7b0-ae41-4f23-9b93-2196bedf6307 req-a8c7e53f-42b8-42bd-bae6-f0910b53ea9f service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:13.686998 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-d3a1b7b0-ae41-4f23-9b93-2196bedf6307 req-a8c7e53f-42b8-42bd-bae6-f0910b53ea9f service nova] Creating event network-vif-plugged:30b575ee-1bf1-44ee-bff6-9db0cee23b07 for instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa on hv-cinder-85426 Aug 24 05:02:13.692612 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-d3a1b7b0-ae41-4f23-9b93-2196bedf6307 req-a8c7e53f-42b8-42bd-bae6-f0910b53ea9f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041018 Aug 24 05:02:13.693574 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 539/1137] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 05:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:24.207842 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:02:24.208574 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Wed Aug 24 05:02:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:02:29.791365 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:02:29.791937 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Wed Aug 24 05:02:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:02:36.765574 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:02:36.766266 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Wed Aug 24 05:02:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:03:24.708845 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:24.709699 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG dbcounter [-] [127415] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:24.713290 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_api:SELECT=26 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:24.714092 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG dbcounter [-] [127416] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:24.714672 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:24.715311 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:24.719277 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-10d2a460-adf0-4c40-9b65-ed0032cb4ede req-8a5ca1d1-be1f-4fdf-a959-d3b1283dba58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c85d840-de5a-4fbc-8b0a-51319cf3fcaa", "tag": "30b575ee-1bf1-44ee-bff6-9db0cee23b07"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:24.723671 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.725207 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.726045 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.726854 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.727399 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.727897 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.731910 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-10d2a460-adf0-4c40-9b65-ed0032cb4ede req-8a5ca1d1-be1f-4fdf-a959-d3b1283dba58 service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.732777 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-10d2a460-adf0-4c40-9b65-ed0032cb4ede req-8a5ca1d1-be1f-4fdf-a959-d3b1283dba58 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.732777 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-10d2a460-adf0-4c40-9b65-ed0032cb4ede req-8a5ca1d1-be1f-4fdf-a959-d3b1283dba58 service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.750295 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-10d2a460-adf0-4c40-9b65-ed0032cb4ede req-8a5ca1d1-be1f-4fdf-a959-d3b1283dba58 service nova] Creating event network-changed:30b575ee-1bf1-44ee-bff6-9db0cee23b07 for instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa on hv-cinder-85426 Aug 24 05:03:24.756860 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-10d2a460-adf0-4c40-9b65-ed0032cb4ede req-8a5ca1d1-be1f-4fdf-a959-d3b1283dba58 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045593 Aug 24 05:03:24.760686 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 540/1138] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 05:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:03:24.764836 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Going to try to terminate instance {{(pid=127415) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:03:24.866721 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-67423531-04f5-4f08-9d9f-d80e3b88c52f tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 204 len: 0 microversion: 2.1 time: 0.160650 Aug 24 05:03:24.867774 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 599/1139] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 24 05:03:24 2022] DELETE /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:03:24.878500 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:24.879390 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:24.888072 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.889018 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.889693 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.890858 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.891920 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.892727 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:25.061946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.policy [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127416) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:25.071668 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-a401a339-c033-486f-9abd-efd410d1c90b tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.197724 Aug 24 05:03:25.072253 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 541/1140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:24 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:26.093304 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:26.094012 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:26.100938 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.101422 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.101850 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.102587 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.103032 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.103475 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.257213 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:26.265296 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-ca1ab098-c730-4172-aa11-53e287ae0d65 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1568 microversion: 2.1 time: 0.176188 Aug 24 05:03:26.266407 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 600/1141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:26 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:26.953035 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [req-afecaf34-3582-43fe-83c2-965d61489979 req-7bfd750f-8986-4eea-b27d-d25b2243c3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c85d840-de5a-4fbc-8b0a-51319cf3fcaa", "name": "network-vif-deleted", "tag": "30b575ee-1bf1-44ee-bff6-9db0cee23b07"}]} {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:26.963946 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-afecaf34-3582-43fe-83c2-965d61489979 req-7bfd750f-8986-4eea-b27d-d25b2243c3dc service nova] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.964423 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-afecaf34-3582-43fe-83c2-965d61489979 req-7bfd750f-8986-4eea-b27d-d25b2243c3dc service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.965237 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [req-afecaf34-3582-43fe-83c2-965d61489979 req-7bfd750f-8986-4eea-b27d-d25b2243c3dc service nova] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.977427 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.compute.server_external_events [req-afecaf34-3582-43fe-83c2-965d61489979 req-7bfd750f-8986-4eea-b27d-d25b2243c3dc service nova] Creating event network-vif-deleted:30b575ee-1bf1-44ee-bff6-9db0cee23b07 for instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa on hv-cinder-85426 Aug 24 05:03:26.982878 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [req-afecaf34-3582-43fe-83c2-965d61489979 req-7bfd750f-8986-4eea-b27d-d25b2243c3dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033526 Aug 24 05:03:26.983485 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 542/1142] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 24 05:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:27.287606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:27.288462 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.compute.api [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127415) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:27.305875 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:27.306606 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:27.307360 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:27.308517 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:27.309343 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:27.310613 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG oslo_concurrency.lockutils [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:27.415866 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.policy [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10a21129e1e419c8ea52d4066c02f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654f48e605347759229022c81f7d39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127415) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:27.430517 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-02741f01-dcf6-4075-ac28-d5829277d719 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 200 len: 1219 microversion: 2.1 time: 0.146569 Aug 24 05:03:27.431707 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 601/1143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:27 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:03:28.453664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '>' {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:28.454401 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.compute.api [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] [instance: 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa] Fetching instance by UUID {{(pid=127416) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:28.460957 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:28.461441 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:28.461876 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:28.462599 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Acquiring lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:28.463047 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:28.463465 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG oslo_concurrency.lockutils [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Lock "e1da3d3a-d71f-44a7-9bcc-c0c528eed093" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:28.478100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.wsgi [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] HTTP exception thrown: Instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa could not be found. Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Request method failure captured: Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: request: GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa HTTP/1.1 Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept: application/json Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Accept-Encoding: identity Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Connection: close Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Length: 0 Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Content-Type: application/json Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Host: 10.222.0.60 Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Openstack-System-Scope: None Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: User-Agent: python-urllib3/1.26.11 Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Auth-Token: gAAAAABjBbAdOMTtkE4WY9YQnW5BN5RU8xdYqGYjj25rA-KPHWkAbxDicQ7PJVRDJLCP0NW0WP42JP8xF7vCBbl-4AucztVXRLePNJUqw_q64pdaVGntu-kMoN5gi-xZ_jpdvBTqClwpOIQxP22MKn9K9cdtoo-11_F5_xDUqTOh2YWx56BCoqU Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Id: None Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Domain-Name: None Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Identity-Status: Confirmed Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Is-Admin-Project: True Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Id: default Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Domain-Name: Default Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Id: e654f48e605347759229022c81f7d39e Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Project-Name: tempest-TestShelveInstance-494395568 Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Role: reader,member Aug 24 05:03:28.479766 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Roles: reader,member Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e654f48e605347759229022c81f7d39e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e654f48e605347759229022c81f7d39e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e654f48e605347759229022c81f7d39e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e654f48e605347759229022c81f7d39e"}]}] Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant: tempest-TestShelveInstance-494395568 Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Id: e654f48e605347759229022c81f7d39e Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-Tenant-Name: tempest-TestShelveInstance-494395568 Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User: tempest-TestShelveInstance-494395568-project Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Id: default Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Domain-Name: Default Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Id: c10a21129e1e419c8ea52d4066c02f36 Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: X-User-Name: tempest-TestShelveInstance-494395568-project Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: method: > Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: exception: Instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa could not be found. Aug 24 05:03:28.481664 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: action_args: {'id': '7c85d840-de5a-4fbc-8b0a-51319cf3fcaa'} Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: {{(pid=127416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa could not be found. Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:03:28.482815 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa could not be found. Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa could not be found. Aug 24 05:03:28.484543 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: ERROR nova.api.openstack.wsgi Aug 24 05:03:28.486161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: DEBUG nova.api.openstack.wsgi [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Returning 404 to user: Instance 7c85d840-de5a-4fbc-8b0a-51319cf3fcaa could not be found. {{(pid=127416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:03:28.486161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO nova.api.openstack.requestlog [None req-80996a87-8f39-454a-971d-738c59bba6f5 tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa" status: 404 len: 111 microversion: 2.1 time: 0.032216 Aug 24 05:03:28.486161 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: [pid: 127416|app: 0|req: 543/1144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:28 2022] GET /compute/v2.1/servers/7c85d840-de5a-4fbc-8b0a-51319cf3fcaa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:03:28.666033 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: DEBUG nova.api.openstack.wsgi [None req-997afb07-dc24-404c-9503-1e3f84885ebe tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] Calling method '.version_select at 0x7fb0500055e0>' {{(pid=127415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:28.692116 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO nova.api.openstack.requestlog [None req-997afb07-dc24-404c-9503-1e3f84885ebe tempest-TestShelveInstance-494395568 tempest-TestShelveInstance-494395568-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-411025658" status: 202 len: 0 microversion: 2.1 time: 0.030697 Aug 24 05:03:28.692744 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: [pid: 127415|app: 0|req: 602/1145] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 24 05:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-411025658 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:03:56.774067 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:03:56.774700 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Wed Aug 24 05:03:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:04:25.490280 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:04:25.490858 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Wed Aug 24 05:04:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:05:44.216215 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:05:44.216914 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Wed Aug 24 05:05:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:05:49.800876 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:05:49.801621 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Wed Aug 24 05:05:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:05:56.774436 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:05:56.775326 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Wed Aug 24 05:05:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:06:13.020477 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:06:13.021100 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Wed Aug 24 05:06:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:07:16.782426 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:07:16.783136 dv-cinder-854264-1-iscsi devstack@n-api.service[127416]: Wed Aug 24 05:07:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:07:45.498522 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:07:45.499144 dv-cinder-854264-1-iscsi devstack@n-api.service[127415]: Wed Aug 24 05:07:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!